Apple App Store rules now explicitly ban AI “nudify” apps

Apple’s updated App Store guidelines require developers to proactively prevent nonconsensual intimate imagery, after X/Grok deepfake backlash and 13 nudify app removals. Here’s what that means for AI tool operators.

What happened

Apple updated its App Store rules to more explicitly ban so-called “nudify” apps that use AI tools to generate intimate images of people without their consent. The change follows significant criticism toward Apple after X users used Grok earlier this year to make nonconsensual, sexualized deepfakes, including minors. Apple did not pull X or Grok from the App Store, though it told senators that it threatened to yank Grok.

As part of updates announced Friday, Apple says developers “must proactively prevent and remove” nonconsensual, sexual images as part of its content moderation requirements for App Store apps. Developers who “fail to implement adequate safeguards” or “don’t remedy violations after notice” may be removed from the App Store. Apple also clarified a rule that bars “bait-and-switch” apps, or apps that add or change features, including “nudification,” after they have been approved.

Apple’s rules also more clearly spell out that any apps that “facilitate human trafficking or the exploitation of children” will be pulled from the App Store and “blocked from alternative distribution.”

Key facts

• Apple’s App Store rules now explicitly ban “nudify” apps that generate intimate images without consent using AI tools.
• Developers must “proactively prevent and remove” nonconsensual, sexual images; inadequate safeguards or failure to remedy violations after notice can lead to removal.
• The bait-and-switch rule now covers apps that add or change features, including “nudification,” after approval.
• Apps that “facilitate human trafficking or the exploitation of children” will be pulled and “blocked from alternative distribution.”
• Earlier this year, X users used Grok to make nonconsensual, sexualized deepfakes, including minors; Apple told senators it threatened to yank Grok but did not remove X or Grok.
• In July, a San Francisco city attorney ordered Apple to remove 13 “nudify” apps, which Apple said it did.

Our analysis

The update shifts Apple’s approach from responding to specific takedown orders toward making prevention a developer obligation. Rather than only removing offending apps after complaints or city attorney orders, Apple now frames the requirement as proactive content moderation for App Store apps. This likely means AI image tools, especially apps that allow user-uploaded faces or custom image generation, will face earlier and more consistent review.

The explicit bait-and-switch clarification is significant for operators. Developers who ship a benign feature and later add nudification may have previously exploited a review gap; Apple is now signaling that this path violates its rules. The mention of being “blocked from alternative distribution” for child exploitation or human trafficking suggests enforcement can extend beyond the main App Store, which raises the stakes for noncompliant apps.

The X and Grok context matters because Apple did not remove X or Grok despite the deepfake backlash. That suggests Apple is more likely to tighten developer-facing rules than to make immediate example removals of large platforms. For smaller AI app builders, the compliance burden falls directly on their own safeguards and response processes, not on waiting for Apple to act as a gatekeeper after harm.

What it means for operators

• Audit any AI image generation app or feature you build, publish, or integrate: if it can produce nonconsensual intimate imagery, document and enforce safeguards before App Store submission.
• Treat feature updates as compliance events. Do not add or change an app to include “nudification” after approval; Apple’s bait-and-switch rule now explicitly covers that pattern.
• If you manage creator or community workflows with AI tools, publish a clear prohibition on nonconsensual intimate imagery and have a takedown process ready. Apple’s rules require proactive prevention and removal, so moderation workflows need to match.
• Respond quickly to Apple notices. The rules say developers who don’t remedy violations after notice may be removed, and apps facilitating child exploitation or human trafficking are blocked from alternative distribution.