Meta took several days to remove ads featuring AI-generated child sexual abuse material (CSAM) from Facebook and Instagram. Some of these ads included real photographs of children, such as a press photo of a young European royal family member and images taken from the Instagram profile of a pre-teenage influencer girl.
In a report published by the Technology Transparency Project (TTP), it was revealed that Meta failed to identify 332 ads containing CSAM this year. The majority of these ads were promoting Chinese AI applications, with a significant number introducing "nudify" apps that allow malicious actors to digitally modify images of children using AI.
TTP was able to match several CSAM ads with real photographs of children that had been published online. These ads appear to violate federal laws on child pornography, as the U.S. Department of Justice has emphasized that AI-generated CSAM is equally harmful. The young royal girl's photograph was turned into a video in which she performs a graphic sexual act; a 14-year-old influencer was also turned into a video performing oral sex, and another pre-teen was shown in a video being abused by an adult man in a distressed state.

