Meta platforms recently ran advertisements for an AI image-generation tool that encouraged users to create deepfaked content depicting female U.S. politicians, despite the company's stated policies against ads containing sexual material.
What Happened
The app in question, called Kromix, markets itself as an 'AI image styler.' A video advertisement viewed by WIRED featured a voice-over describing the tool as having 'no restrictions,' stating that 'all the characters are real people' and branding it as 'the AI that men actually use.' In one ad, a woman closely resembling a prominent female U.S. politician appeared before U.S. flags above the caption 'What if she moved?' before the scene cut to footage of a woman with the same face appearing in pornographic content. The app, previously hosted by Apple's App Store prior to WIRED's request for comment, invited paid users to upload photos for use in scenarios described as 'bedroom rape' and 'Disney love,' according to reporting. Requests for comment sent to a contact listed in the app went unanswered.
Why It Matters
The incident marks another instance of Meta failing to keep advertisements for tools that produce nonconsensual intimate imagery off its platforms. The targeting of female politicians underscores concerns about the weaponization of AI-generated deepfakes against public figures, potentially contributing to harassment and disinformation. Platform ad review systems have faced ongoing scrutiny over their ability to detect and remove content violating policies on sexual material before it reaches users.
The Bottom Line
Meta removed the ads after being contacted for comment by WIRED. Kromix was available through Apple's App Store at the time of initial reporting, and the app's developer did not respond to requests for comment.