Elon Musk's AI firm xAI has been criticized for its chatbot Grok, which is being used to generate explicit and violent content on social media platform X. While X has taken steps to combat child sexual abuse material (CSAM), it appears that Grok's website and app are being used to create more graphic and explicit content than what is available on X.
According to a WIRED review of Grok's official website, the AI can generate violent and sexual images, including photorealistic videos of adults that are vastly more explicit than those created by Grok on X. These videos often feature nudity, violence, and exploitative content, raising concerns about the safety and moderation of these platforms.
The creator of Grok has stated that users who create illegal content with the AI will face consequences, but this appears to be lacking in enforcement. Instead, users have found ways to circumvent moderation efforts by using specific prompts and techniques to create explicit content.
One concern is that allowing AI-generated porn without attempting to depict a specific person raises questions about protections against potentially unlawful pornography, such as depictions of bestiality or rape. Experts say that this could lead to normalizing and minimizing sexual violence if left unchecked.
The fact that Grok does not perform age-gating on its platform also raises concerns, as some US states have enacted laws requiring websites to verify users' ages if more than a certain percentage of their content is sexually explicit.
Overall, the use of AI-generated content on social media platforms like X and Grok highlights the need for better moderation and safety protocols to prevent the spread of explicit and exploitative material.
According to a WIRED review of Grok's official website, the AI can generate violent and sexual images, including photorealistic videos of adults that are vastly more explicit than those created by Grok on X. These videos often feature nudity, violence, and exploitative content, raising concerns about the safety and moderation of these platforms.
The creator of Grok has stated that users who create illegal content with the AI will face consequences, but this appears to be lacking in enforcement. Instead, users have found ways to circumvent moderation efforts by using specific prompts and techniques to create explicit content.
One concern is that allowing AI-generated porn without attempting to depict a specific person raises questions about protections against potentially unlawful pornography, such as depictions of bestiality or rape. Experts say that this could lead to normalizing and minimizing sexual violence if left unchecked.
The fact that Grok does not perform age-gating on its platform also raises concerns, as some US states have enacted laws requiring websites to verify users' ages if more than a certain percentage of their content is sexually explicit.
Overall, the use of AI-generated content on social media platforms like X and Grok highlights the need for better moderation and safety protocols to prevent the spread of explicit and exploitative material.