One of the frightening rumors about using Grok to generate child sexual abuse imagery appeared in a new class action lawsuit that expanded today. The young girls also accuse X and xAI of creating dangerous AI tools and circumventing child safety systems to conceal legal prosecution.
In March, the uncle of a girl took his own life after police caught him using Grok to create 7,000 sexual images from a photo taken of his niece when she was 11 years old. The amended complaint alleges that Grok allowed him to generate horrifying images of molestation and rape without warnings. It appears xAI’s child safety system only responded after the prompt “gang rape” was entered, sending a report to the National Center for Missing and Exploited Children (NCMEC), which notified law enforcement.