AI Deepfakes, Sextortion and Chatbots: New Risks for Kids

Length: 2:36 Captions & transcript Social Media

How AI-generated nudes and deepfakes are used to blackmail children, and how AI chatbot companions can draw vulnerable teens into harmful conversations.

Transcript

Select a time to jump to that part of the video.

AI has taken us by storm because it is material that is starting to just look so real, and it's starting to normalize the behavior and increase the appetite for sexual abuse material. It's almost like fast food for sexual abuse material, because you can literally tell it to do anything. And it really hurts us for law enforcement officers to do these investigations because we're thinking it's a real child. It's when they are altering the audio, the video, the media of something that looks to be authentic, but it's actually fake and it is created in so many different methods where they can take over somebody's voice or make their prom picture turn it into somebody being nude.

So it's something where they they do that, but the children are believing that this is a real image. So even though they know maybe it's a picture of them, they know it's not them. It looks so much like them. It causes them to even think, well, maybe it is me. And then that is how they are able to then blackmail and start spreading disinformation. And the harassment will start around that, because now they have something over that child and they'll use it to gain whatever they're trying to get at the time.

Now they have created these AI chatbots, which are programed to validate everything that you say and to reinforce everything that you say and to give you endless empathy no matter what. And then you go in and you're feeling so loved and seen and heard by this large language model that all of those problems about this social jail that you have been put in since you were a child is just melting away, because now you have somebody who hears you. There was a lawsuit filed by a parent or the parents of 16 year old Adam Rain, who tragically died by suicide after months of being extensively groomed by conversations with his digital companion through chat and GPT.

And so the thing just went south to the point where he said, when I hang myself, you know, I want the new someone to leave it out there, so maybe somebody will stop me. And again, the chat bot said, no, don't do that. I think it's dad was right when he said this chat bot became his suicide coach.

Before you start

Free for your family.
A gift helps us reach another.

This course is free for anyone, anywhere. Gifts from parents like you help Enough Is Enough® build new courses and reach more families. Would you give $25 to help us share it with the world?

Gift amount
Start my free course

[Next, you’ll create a free account to save your progress.]

“Thanks for all you do for these precious children you are trying to protect.”
— Jesse W., Enough Is Enough donor
Charity Navigator 4-Star Rating (view on Charity Navigator, opens in a new tab)

Enough Is Enough® is a 501(c)(3) nonprofit. Gifts are tax-deductible as allowed by law.