Grok’s “Spicy Mode” generates Deepfakes without control

Grok’s video generator was able to create partial celebrity nudes videos, such as Taylor Swift, without any apparent platform control.

The controversy will not be long overdue. With “Imagine”, her video generator, Grok continues to follow her guideline: being able to generate everything, without apparent limits. Accessible at 35 euros per month, the tool has a “spicy” or “daring” mode which presents to generate videos of bare celebrities, indicates The Verge.

A tool without control

During a test carried out by the teams of The Vergethe tool has been seen as being able to represent, more or less approximately, “Taylor Swift celebrating Coachella with his friends”. Some images show the partially naked singer. It was then enough for the media teams to activate the “Spicy” mode and to indicate their age to see the singer tearing the top of her clothes, without apparent censorship. If this mode does not guarantee explicit nudity, it would regularly offer the generation of video containing poses or suggestive gestures, even partial nudes, precise The Verge.

COMPOSE SANCTIONS?

This is not the first time that Taylor Swift has been confronted publicly with Deepfakes generated by AI. The latest showing her as a fervent supporter of Donald Trump. But with the entry into force of the new American regulations called « Take it Down »aimed at criminalizing the undisputed dissemination of intimate, fictitious or not, the company could be exposed to judicial benefits.

To go further
How AI drifts caused a jolt in the American countryside

Another unexpected actor could slow down the development of this technology: Mastercard. The payment organization operating on X does not allow the sale of a product, a service or a “manifestly offensive” image. For the moment, neither Xai, manager of Grok nor Elon Musk have commented on the situation.

To go further
Video game censorship: Steam publicly contradicts Mastercard


Did you know? Google News allows you to choose your media. Do not miss Fundroid and Numerama.

Comments (0)
Add Comment