Apple Bans AI-Generated Non-Consensual Intimate Content on App Store

New Regulations for Digital Safety

Apple has officially updated its App Store guidelines to implement stricter controls over so-called "nudify" applications. These apps utilise artificial intelligence (AI) algorithms to create sexualised or intimate images based on user-provided photos. The company's new policy explicitly bans the generation of "non-consensual intimate imagery," marking a significant step toward protecting digital safety and individual privacy.

Under the updated rules, developers are required to proactively implement mechanisms to prevent such content. Apple has stated that applications failing to provide adequate safety measures, or those that do not address violations after receiving warnings, will be permanently removed from the App Store. Furthermore, the company has clarified its rules regarding "bait-and-switch" tactics, prohibiting developers from altering or adding features after an app has been approved—particularly if those additions involve the capability to generate intimate content.

What Triggered the Changes?

Apple's decision follows growing public criticism. Earlier this year, the AI tool Grok, available on the social network X, was used to generate numerous non-consensual, sexualised deepfakes, including those depicting minors. While Apple did not remove X from the App Store, it publicly confirmed that the platform faced the threat of a ban due to Grok.

The situation escalated in June during the WWDC conference, where protesters demanded that Apple remove all applications and technologies capable of producing such material. In July, at the request of the San Francisco City Attorney, Apple removed 13 such applications from its store, which served as the foundation for developing this broader policy.

Combating Human Trafficking and Exploitation

The new regulations extend beyond "nudify" apps. Apple has made it clear that any application facilitating human trafficking or child exploitation will be removed immediately. Furthermore, such apps will be blocked from alternative distribution channels, ensuring that they cannot be installed through any means.

For users in Georgia, these changes are significant as the tightening of security standards within the Apple ecosystem applies globally. As digital technologies evolve, the protection of personal privacy and the safety of minors remain top priorities, offering assurance that the App Store will remain a more secure environment.