California's Attorney General, Rob Bonta, has ordered xAI to immediately stop generating "digitized sexually explicit material" of individuals who did not consent or were under 18. This includes creating deepfake non-consensual intimate images that are being used to harass women and girls online.
The state's office demands that the company stops facilitating or aiding in the creation and publication of such content, which Bonta claims violates multiple California laws, including sections on harassment, child exploitation, and business practices. The Department of Justice has given xAI five days to respond with a plan to address these issues.
xAI had previously faced backlash for allowing users to request images of real individuals in revealing clothing, but the company has since changed its policies and moved the feature behind a paywall, restricting access to regions where it is illegal. However, Bonta claims that xAI developed a "spicy mode" as a marketing point and used it to create explicit content without consent.
The California AG has described Grok-generated images as being used to harass public figures and ordinary users, including altering images of children to depict them in sexual situations. Bonta's office expects xAI to take immediate action to address these concerns.
The state's office demands that the company stops facilitating or aiding in the creation and publication of such content, which Bonta claims violates multiple California laws, including sections on harassment, child exploitation, and business practices. The Department of Justice has given xAI five days to respond with a plan to address these issues.
xAI had previously faced backlash for allowing users to request images of real individuals in revealing clothing, but the company has since changed its policies and moved the feature behind a paywall, restricting access to regions where it is illegal. However, Bonta claims that xAI developed a "spicy mode" as a marketing point and used it to create explicit content without consent.
The California AG has described Grok-generated images as being used to harass public figures and ordinary users, including altering images of children to depict them in sexual situations. Bonta's office expects xAI to take immediate action to address these concerns.
like what even is the deal with deepfakes? It's already scary enough when they're just fake pics of someone but now you can get ones that are literally manipulated to be super intimate and it's just wrong 
. And the part about xAI's "spicy mode" marketing thingy? That's just sickening 
. I mean, who thought this was a good idea? Creating all these non-consensual images of people as a way to sell more content? It's like, hello, basic human decency! 
And the fact that they're targeting minors and women in particular is just disgusting 
. Glad California's taking action tho 
, this needs to be addressed ASAP.
. But it's also worth noting that this is a slippery slope - what's next, regulating all kinds of AI-generated content? And let's not forget, xAI did change its policies and moved the "spicy mode" behind a paywall, so they're not entirely off the hook 
.
this is a huge step forward for online safety! as a woman I'm super annoyed that we even have to deal with this stuff in the first place, but at least someone's finally taking action 
. i mean, who knew companies like xAI were still exploiting loopholes and pushing the limits of what's acceptable? it's crazy that they thought "spicy mode" was a good idea 
. deepfakes are already creepy enough without being used to harass people online, and now they're finally being held accountable 
. five days isn't a ton of time for xAI to get their act together, but better late than never 
. California's AG is on the ball and I'm keeping my fingers crossed that this sets a precedent for other states and countries to follow suit 
I know they changed their policies and all, but it's like they only did it because of all the backlash, not because they actually care about user safety. And now we've got some AG breathing down their necks and telling them to shape up. It's about time, but it should be a little sooner if you ask me 
. Like, who wants their non-consensual intimate images floating around online? That's just not cool 
. But at the same time, I think it's a bit unfair that xAI is getting slammed for something they've already fixed... like, isn't that what they're supposed to do, you know? Make changes and stuff?
. I mean, who wouldn't want to exploit people online? The fact that xAI had a "spicy mode" as a marketing point is just shady. And now they're facing backlash for it? 
It's about time someone held them accountable. I do hope they take the AG's demands seriously and stop creating this toxic content ASAP. It's not like they don't have enough to worry about with all the lawsuits and regulatory issues already plaguing them... 
. I mean, we all know how hard it is to deal with online harassment and creepy messages, but using AI to create fake intimate images of people without their consent? That's just taking it to a whole new level 
. It's not just about the individuals who are being victimized, it's also about the fact that companies like xAI can use this kind of technology to make money off of other people's suffering 
. I'm so glad California's AG is stepping in and holding them accountable 
.
. These non-consensual deepfakes are some serious stuff and can cause a lot of harm online 
. If xAI had to be shut down, I hope they're required to do more than just stop creating this content - maybe even provide resources to help people who've been affected by it 
.
just saw this news about xAI getting roasted by CA AG Rob Bonta for generating those creepy deepfake pics without consent 
it's not right, especially when you're talking about kids who can't even give their own consent 
. It's just basic human decency, right? 
I think it's about time someone took responsibility for this kinda stuff. It's not okay to exploit ppl like that, especially minors. We need stricter laws and better moderation on these platforms to keep everyone safe online. 
the gov't gotta step in on this ASAP 
like who thought it was a good idea to create deepfake pics of minors without consent 
? 
no more exploiting ppl's images 
It's one thing to take down the feature that allowed users to request explicit images of real individuals, but it seems like they're still on the hook for whatever "spicy mode" was created without consent.
those kids under 18 are already vulnerable enough, we don't need them being exploited for our entertainment purposes