Meta took days to remove ads containing AI-generated child sexual abuse material (CSAM) on Facebook and Instagram. Some ads featured photos of real kids, including a press photo of a young member of a European royal family and images swiped from a popular Instagram profile of a preteen girl deemed an influencer.

In an investigation published Tuesday, the Tech Transparency Project (TTP) reported that Meta failed to detect 332 ads containing CSAM this year. The “vast majority” of ads promoted AI apps made in China, while many ads promoted so-called “nudify” apps that make it easy for bad actors to use AI and digitally alter images of children.

TTP matched “multiple CSAM ads to photos of real children that appeared online.” These ads seem to violate federal child pornography laws, since the Justice Department has clarified that AI CSAM is just as harmful as CSAM. The young royal’s image was “animated into a video of her performing a graphic sex act,” TTP found. Other ads animated a photo of a 14-year-old Instagram influencer “showing off her new sports club uniform” into “a video of her performing oral sex.” A third “preteen” victim “posing in a pink athletic outfit with pigtails” in a series of stock photos was morphed into a video where she looks frightened as she’s molested by an adult male, TTP reported.

Read full article

Comments

Apple has begun removing AI-powered “nudify” apps from its App Store after San Francisco City Attorney David Chiu issued cease-and-desist letters to both Apple and Google, accusing the platforms of facilitating harmful non-consensual intimate imagery.

The letters targeted approximately 13 face-swapping and image-altering apps that use artificial intelligence to digitally remove clothing from photos, creating fake nude or explicit images without the subject’s consent. Chiu argued that the apps violate consumer-protection laws and enable the spread of deepfake pornography, often targeting women and minors.

In response, Apple in a statement reiterated its longstanding policy prohibiting apps that generate or promote explicit non-consensual content. “Nudification apps are against our App Review Guidelines and we have proactively rejected many of these apps and removed many others,” the company said. It confirmed the removal of three apps identified in the letter, the termination of their developers’ accounts, and ongoing outreach to four additional developers who must address violations or face removal.

This action follows earlier reports highlighting the persistence of such apps despite Apple’s rules. In 2024 and earlier in 2026, investigations revealed that “nudify” tools continued to appear or be advertised in the App Store, prompting criticism over enforcement gaps. Apple has since taken down batches of violating apps after external reports and user flags.

The San Francisco order gives Apple and Google 28 days to respond and fully address the issue, with potential civil penalties for non-compliance. Advocates have praised the move as a step toward curbing AI-enabled abuse, while noting that similar tools can still proliferate on the open web or through sideloaded software.

Apple’s latest enforcement underscores growing pressure on tech platforms to prevent their stores from becoming distribution channels for tools that weaponize AI against privacy and consent.
‎
MacDailyNews Take: Users are encouraged to report suspected violating apps directly through the App Store via Apple’s “Report a Problem” page: https://reportaproblem.apple.com

‎
Please help support MacDailyNews — and enjoy subscriber-only articles, comments, chat, and more — by subscribing to our Substack: macdailynews.substack.com. Thank you!

Support MacDailyNews at no extra cost to you by using this link to shop at Amazon.

The post Apple purges AI ‘nudify’ apps from App Store after San Francisco demands crackdown on non-consensual deepfakes appeared first on MacDailyNews.

This week, San Francisco’s attorney general, David Chiu, sent cease-and-desist letters, demanding that Apple and Google remove 13 so-called nudification apps from their app stores, Wired reported.

Nudification apps can make it trivially easy to transform ordinary photos of real people into explicit images. The harmful AI tools allow bad actors to remove clothing, change a person’s features, place them in sexualized positions, and swap victims’ faces onto other people’s naked bodies.

Chiu's letter warned that app stores were violating "California’s laws that prohibit supporting services that create deepfake pornography," Wired reported.

Read full article

Comments