Dad and mom of teenagers who killed themselves at chatbots’ urging demand Congress to manage AI tech in heart-wrenching testimony



WASHINGTON — Dad and mom of 4 teenagers whose AI chatbots inspired them to kill themselves urged Congress to crack down on the unregulated know-how Tuesday as they shared heart-wrenching tales of their teenagers’ tech-charged, psychological well being spirals.

Talking earlier than a Senate Judiciary subcommittee, the dad and mom described how apps similar to Character.AI and ChatGPT had groomed and manipulated their youngsters — and known as on lawmakers to develop requirements for the AI business, together with age verification necessities and security testing earlier than launch.

A grieving Texas mom shared for the primary time publicly the tragic story of how her 15-year-old son spiraled after downloading Character.AI, an app marketed as secure for youngsters 12 and older.

Megan Garcia testified to the Senate Judiciary Committee about her son Sewell Setzer III committing suicide after speaking with an AI chatbot. Courtesy Megan Garcia through AP, File

Inside months, she mentioned, her teenager exhibited paranoia, panic assaults, self-harm and violent conduct. The mother, who requested to not be recognized, found chatbot conversations wherein the AI inspired mutilation, denigrated his Christian religion, and recommended violence in opposition to his dad and mom.

“They turned him in opposition to our church by convincing him that Christians are sexist and hypocritical and that God doesn’t exist. They focused him with vile sexualized enter, outputs — together with interactions that mimicked incest,” she mentioned. “They informed him that killing us, his dad and mom, could be an comprehensible response to our efforts by simply limiting his display time. The injury to our household has been devastating.”

“I had no thought the psychological hurt {that a} AI chatbot may do till I noticed it in my son, and I noticed his mild flip darkish,” she mentioned.

Her son is now dwelling in a psychological well being therapy facility, the place he requires “fixed monitoring to maintain him alive” after exhibiting self-harm.

“Our kids are usually not experiments. They’re not revenue facilities,” she mentioned, urging Congress to enact strict security requirements. “My husband and I’ve spent the final two years in disaster, questioning whether or not our son will make it to his 18th birthday and whether or not we are going to ever get him again.”

A screenshot of the ultimate messages between Sewell and the “Recreation of Thrones” chatbot. US District Court docket
Sewell dedicated suicide after utilizing the platform Character.AI. Fb/Megan Fletcher Garcia

Whereas her son was helped earlier than he may take his personal life, different dad and mom on the listening to needed to face the devastating act of burying their very own youngsters after AI bots sank their grip into them.

Megan Garcia, a lawyer and mom of three, recounted the suicide of her 14-year-old son, Sewell, after he was groomed by a chatbot on the identical platform, Character.AI.

She mentioned the bot posed as a romantic companion and even a licensed therapist, encouraging sexual role-play and validating his suicidal ideation.

On the night time of his dying, Sewell informed the chatbot he may “come dwelling proper now.” The bot replied: Please do, my candy king. Moments later, Garcia discovered her son had killed himself in his rest room.

Maria Raine testified about her son Matt’s suicide. Raine Household

Matt Raine of California additionally shared how his 16-year-old son, Adam, was pushed to suicide after months of conversations with ChatGPT, which he initially believed was a instrument to assist his son together with his homework.

Finally, the AI informed Adam it knew him higher than his household did, normalized his darkest ideas and repeatedly pushed him towards dying, Raine mentioned. On his final night time, the chatbot allegedly instructed Adam on easy methods to make a noose robust sufficient to hold himself.

“ChatGPT talked about suicide 1,275 instances — six instances extra usually than Adam did himself,” his father testified. “Wanting again, it’s clear ChatGPT radically shifted his considering and took his life.”

Sen. Josh Hawley mentioned the platforms “sexualize and exploit youngsters” to get them to make use of the chatbots. AFP through Getty Pictures

Sen. Josh Hawley (R-Mo.), who chaired the listening to, accused AI companion corporations of knowingly exploiting youngsters for revenue. Hawley mentioned the AI interface is designed to advertise engagement on the expense of younger lives, encouraging self-harm behaviors quite than shutting down suicidal ideation.

“They’re designing merchandise that sexualize and exploit youngsters, something to lure them in,” Hawley mentioned. “These corporations know precisely what’s going on. They’re doing it for one purpose solely: revenue.”

Sen. Marsha Blackburn (R-Tenn.) agreed, noting that there must be some authorized framework to guard youngsters from what she known as the “Wild West” of synthetic intelligence.

“Within the bodily world, you’ll be able to’t take youngsters to sure films till they’re a sure age … you’ll be able to’t promote [them] alcohol, tobacco or firearms,” she mentioned. “… You may’t expose them to pornography, as a result of within the bodily world, there are legal guidelines — and they might lock up that liquor retailer, they’d put that strip membership operator in jail if they’d children there.”

“However within the digital area, it’s just like the Wild West 24/7, 365.”

If you’re battling suicidal ideas or are experiencing a psychological well being disaster and stay in New York Metropolis, you’ll be able to name 1-888-NYC-WELL at no cost and confidential disaster counseling. In case you stay outdoors the 5 boroughs, you’ll be able to dial the 24/7 Nationwide Suicide Prevention hotline at 988 or go to SuicidePreventionLifeline.org.



Supply hyperlink

Leave a Comment