Meta has recently run advertisements for an AI-based porn generation tool that appears to encourage users to create deepfake videos resembling US female politicians, despite the company's policies against ads containing sexual content.
The tool, named Kromix, describes itself as an "AI image styler". In one video ad, a voiceover claims the tool is "unrestricted", states that "all characters are real people", and describes it as "the AI that men actually use". In another ad, a woman resembling a prominent US female politician appears in front of the American flag and the presidential flag, with the caption "What if she moves?"; the woman then winks, and the scene cuts to a pornographic video featuring the same face.
The Kromix app, which was available on the Apple App Store prior to WIRED's inquiry, invites paying users to upload their photos to be used in scenarios such as "bedroom rape" and "Disney love". The videos available in the app also include AI-generated porn scenes featuring women in Spider-Man costumes. Inquiries for comment sent via the contact information provided in the app were not answered.