July 9th, 2024

Spain sentences 15 schoolchildren over AI-generated naked images

Fifteen Spanish schoolchildren receive probation for creating AI-generated deepfake images of classmates, sparking concerns about technology misuse. They face education on gender equality and responsible tech use. Families stress societal reflection.

Read original articleLink Icon
Spain sentences 15 schoolchildren over AI-generated naked images

Fifteen schoolchildren in south-west Spain have been sentenced to a year's probation for creating and spreading AI-generated images of their female classmates. The case raised concerns about the harmful use of deepfake technology. The teenagers were convicted of creating child abuse images and offenses against their victims' moral integrity. They used artificial intelligence applications to superimpose girls' faces from social media onto naked bodies, sharing the manipulated photos on WhatsApp. The minors were ordered to attend classes on gender equality awareness and responsible technology use. The incident caused anxiety and fear among the victims, prompting a debate on the importance of educating youth about equality and proper sex education to prevent such incidents. The affected families emphasized the need for societal reflection on gender equality and the dangers of misinformation. The minors involved, aged between 13 and 15, cannot be charged under Spanish law but will undergo rehabilitation courses.

Related

EU cancels vote on private chat app law amid encryption concerns

EU cancels vote on private chat app law amid encryption concerns

The European Union cancels vote on law targeting child sexual abuse material over encryption concerns. Proposed measures involve scanning images on messaging apps, sparking privacy debates among member states. Negotiations ongoing.

Spain introduces "Porn Passport" to keep kids from watching porn

Spain introduces "Porn Passport" to keep kids from watching porn

Spain launches "Digital Wallet Beta" to restrict minors' access to adult content online. Users verify age for 30 "porn credits" with privacy focus. Aligns with EU law, transitioning to eIDAS2 for broader services.

First-known TikTok mob attack led by middle schoolers tormenting teachers

First-known TikTok mob attack led by middle schoolers tormenting teachers

Eighth graders in a wealthy Philadelphia suburb conducted extreme online harassment against teachers, creating fake TikTok accounts with offensive content. School responded with brief suspensions and cyberbullying awareness. Teachers felt slandered.

Google's Nonconsensual Explicit Images Problem Is Getting Worse

Google's Nonconsensual Explicit Images Problem Is Getting Worse

Google is struggling with the rise of nonconsensual explicit image sharing online. Despite some efforts to help victims remove content, advocates push for stronger measures to protect privacy, citing the company's capability based on actions against child sexual abuse material.

Effective CSAM filters are impossible because what CSAM is depends on context

Effective CSAM filters are impossible because what CSAM is depends on context

Filters struggle to detect child sexual exploitation materials due to contextual nuances. Technical solutions like hashing or AI lack context, leading to privacy invasion and mislabeling. Effective prevention requires holistic interventions over technological reliance.

Link Icon 7 comments
By @frakt0x90 - 5 months
Good! Tools like this will only get easier to use and more convincing. AI is always going to outpace regulations but we need to try to prevent abuse like this and much more. People have killed themselves over leaked pictures like this.
By @fiso64 - 5 months
>Each of the defendants was handed a year’s probation and ordered to attend classes on gender and equality awareness

Sounds like it has absolutely nothing to do with gender inequality and everything to do with a teenager's spiking hormones.

By @nashashmi - 5 months
> Police identified several teenagers aged between 13 and 15 as being responsible for generating and sharing the images.
By @grecy - 5 months
It's going to get really interesting when AI starts making questionable images unprompted to do so.
By @bell-cot - 5 months
HN: Might you know of any country with even a half-decent policy to deal with these kinds of cases? (And what's that policy?)

I could see putting it on the kids' permanent record - both police & school - but that's probably of minimal deterrent value for a large fraction of young kidiots*. Not that catching the perp's is any sort of sure thing, either.

It'd be lovely if one could "re-train" youth culture, to greatly reduce the impact/thrill of the crime. I'd guess that that's the only payoff for 98% of perps. But in a world where (by many accounts) kids are often routinely browsing "extreme" porn years before many of their parents are comfortable with them being taught anything more adult than "when a man and a woman love each over very much..." - it's hard to imagine that the school or authorities could actually do that.

(Any thoughts?)

*Yes, like most old men, I was once a young idiot. No offenses remotely resembling this...but that was back in the days when a line-printer-on-green-bar-paper dirty image was still cutting-edge smut.

By @narag - 5 months
In Spain minors hardly get any time even for serious offenses.

Just read after the headline...