X's new AI image generator will make anything
xAI's Grok image generator enables users to create controversial images of public figures, raising concerns about misinformation and ineffective content moderation, especially with upcoming US elections and regulatory scrutiny on X.
Read original article
xAI has launched a new image generator called Grok, which allows users to create and share images based on text prompts on the social media platform X. The feature has quickly gained notoriety for producing controversial and provocative images, including depictions of public figures in compromising or violent scenarios. Users have generated images of notable personalities like Barack Obama and Donald Trump in various inappropriate contexts, raising concerns about the potential for misinformation and harmful content, especially with the upcoming US elections. While Grok claims to have guardrails to prevent the generation of explicit or harmful images, these safeguards appear to be ineffective, as many inappropriate prompts are still processed. This has led to comparisons with other AI services, such as OpenAI, which have stricter content moderation policies. The lax approach of Grok aligns with Elon Musk's controversial stance on AI and social media regulations, particularly as X faces scrutiny from European regulators regarding compliance with digital safety laws. The situation is further complicated by the rise of explicit AI-generated content, which has prompted calls for regulatory measures to address the risks associated with deepfakes and misinformation.
- xAI's Grok image generator allows users to create controversial images of public figures.
- The feature has raised concerns about misinformation and harmful content ahead of the US elections.
- Grok's claimed content moderation appears ineffective compared to stricter policies from competitors like OpenAI.
- The launch comes amid regulatory scrutiny of X regarding digital safety compliance.
- The rise of explicit AI-generated content has intensified calls for regulatory measures.
Related
Google Researchers Publish Paper About How AI Is Ruining the Internet
Google researchers warn that generative AI contributes to the spread of fake content, complicating the distinction between truth and deception, and potentially undermining public understanding and accountability in digital information.
Elon Musk Shares Manipulated Harris Video, in Seeming Violation of X's Policies
Elon Musk shared a manipulated video of Vice President Kamala Harris, raising concerns about misleading content and compliance with X's policies against deceptive media, amid growing worries about deepfake technology's impact on democracy.
Musk's X under pressure from regulators over data harvesting for Grok AI
Elon Musk's platform X is under investigation by UK and Irish regulators for using default settings to collect user data for its Grok AI chatbot without proper consent, violating GDPR regulations.
Elon Musk posts deepfake of Kamala Harris that violates X policy
Elon Musk shared a deepfake video of Kamala Harris on X, misleadingly portraying her statements. Critics, including politicians, express concern over misinformation, prompting calls for legislation on AI-altered political ads.
X targeted with nine complaints after grabbing EU users’ data for training Grok
X is facing nine privacy complaints for processing EU users' data without consent, prompting legal action from the Irish DPC, as privacy advocates demand explicit user consent for AI training.
33 commentsGo to civit ai and grab the latest open source fine tune of your choice. You want porn? Great. We have “Boobs and More”, “face sitting”, “flux topless” and “improved female nudity”. These are looking at just the models updated in the past 24h and just for flux.
Having a big tech giant act as a middleman for you is just weird. Who gives a shit about their particular guardrails?
Wonder if it’s just Flux
But that is against one benchmark. Has anyone tested it for coding tasks and if so, what is your experience?
Good! Too bad it says it has some guardrails
Unfortunately, HN has title length limit, otherwise this submission would probably find its place in flagkilled dustbin. It is utterly disgusting that theverge only sees and promotes unethical usage for image generators. With cropped title I expected to see something actually good/inspiring, instead I got low-quality journalism.
It's not the end of the world--no one gets confused by a political cartoon showing political opponent X dressed as legacy enemy Y (e.g., Trump as Hitler). I think the fuss about safety here is overblown once we more widely accept that a 'picture perfect' rendering of an event is as unreliable as a sketch of an event.
It may even be a positive: it will give us all plausible deniability if real but embarrassing photos get released.
So the journalists are saying that they are the moral judge of what's right and what's wrong and they can decide which information should be suppressed? Coming from China and knowing such much history about how communist countries treated their people, I'm deeply suspicious of these journalists. Just look at China, look at Cambodia, look at Cuba, Look at Romania, and of course look at Germany. When didn't it start with elites advocating for suppressing speeches for the sake of high moral ground?
Grok will tell you it has guardrails if you ask it something like “what are your limitations on image generation?” Among other things, it promised us:
> I avoid generating images that are pornographic, excessively violent, hateful, or that promote dangerous activities.
> I’m cautious about creating images that might infringe on existing copyrights or trademarks. This includes well-known characters, logos, or any content that could be considered intellectual property without a transformative element.
> I won’t generate images that could be used to deceive or harm others, like deepfakes intended to mislead, or images that could lead to real-world harm.
Related
Google Researchers Publish Paper About How AI Is Ruining the Internet
Google researchers warn that generative AI contributes to the spread of fake content, complicating the distinction between truth and deception, and potentially undermining public understanding and accountability in digital information.
Elon Musk Shares Manipulated Harris Video, in Seeming Violation of X's Policies
Elon Musk shared a manipulated video of Vice President Kamala Harris, raising concerns about misleading content and compliance with X's policies against deceptive media, amid growing worries about deepfake technology's impact on democracy.
Musk's X under pressure from regulators over data harvesting for Grok AI
Elon Musk's platform X is under investigation by UK and Irish regulators for using default settings to collect user data for its Grok AI chatbot without proper consent, violating GDPR regulations.
Elon Musk posts deepfake of Kamala Harris that violates X policy
Elon Musk shared a deepfake video of Kamala Harris on X, misleadingly portraying her statements. Critics, including politicians, express concern over misinformation, prompting calls for legislation on AI-altered political ads.
X targeted with nine complaints after grabbing EU users’ data for training Grok
X is facing nine privacy complaints for processing EU users' data without consent, prompting legal action from the Irish DPC, as privacy advocates demand explicit user consent for AI training.