What Can We Do About Abusive Chatbots? With Meetali Jain and Camille Carlton
Media Type |
audio
Publication Date |
Nov 07, 2024
Episode Duration |
00:48:44

CW: This episode features discussion of suicide and sexual abuse. 

In the last episode, we had the journalist Laurie Segall on to talk about the tragic story of Sewell Setzer, a 14 year old boy who took his own life after months of abuse and manipulation by an AI companion from the company Character.ai. The question now is: what's next?

Megan has filed a major new lawsuit against Character.ai in Florida, which could force the company–and potentially the entire AI industry–to change its harmful business practices. So today on the show, we have Meetali Jain, director of the Tech Justice Law Project and one of the lead lawyers in Megan's case against Character.ai. Meetali breaks down the details of the case, the complex legal questions under consideration, and how this could be the first step toward systemic change. Also joining is Camille Carlton, CHT’s Policy Director.

RECOMMENDED MEDIA

lawsuit-teen-suicide.html">Further reading on Sewell’s story

Laurie Segall’s interview with Megan Garcia 

v-Character-Technologies-Complaint-10-23-24.pdf">The full complaint filed by Megan against Character.AI 

Further reading on suicide bots 

Further reading on Noam Shazier and Daniel De Frietas’ relationship with Google 

The CHT Framework for Incentivizing Responsible Artificial Intelligence Development and Use 

Organizations mentioned: 

The Tech Justice Law Project

The Social Media Victims Law Center

Mothers Against Media Addiction

Parents SOS

together.org/">Parents Together

Common Sense Media

RECOMMENDED YUA EPISODES

When the "Person" Abusing Your Child is a Chatbot: The Tragic Story of Sewell Setzer

Jonathan Haidt On How to Solve the Teen Mental Health Crisis

AI Is Moving Fast. We Need Laws that Will Too.Corrections: Meetali referred to certain chatbot apps as banning users under 18, however the settings for the major app stores ban users that are under 17, not under 18.

Meetali referred to Section 230 as providing “full scope immunity” to internet companies, however Congress has passed subsequent laws that have made carve outs for that immunity for criminal acts such as sex trafficking and intellectual property theft.

Your Undivided Attention is produced by the Center for Humane Technology. Follow us on Twitter: @HumaneTech_

Sewell Setzer’s mom, Megan, is suing Character.ai for the role it played in her son’s death. The outcome could force the company–and potentially the entire AI industry–to change its ways. Today on the show, one of Megan’s lawyers, Meetali Jain, breaks down how the case could lead to systemic change.

CW: This episode features discussion of suicide and sexual abuse. 

In the last episode, we had the journalist Laurie Segall on to talk about the tragic story of Sewell Setzer, a 14 year old boy who took his own life after months of abuse and manipulation by an AI companion from the company Character.ai. The question now is: what's next?

Megan has filed a major new lawsuit against Character.ai in Florida, which could force the company–and potentially the entire AI industry–to change its harmful business practices. So today on the show, we have Meetali Jain, director of the Tech Justice Law Project and one of the lead lawyers in Megan's case against Character.ai. Meetali breaks down the details of the case, the complex legal questions under consideration, and how this could be the first step toward systemic change. Also joining is Camille Carlton, CHT’s Policy Director.

RECOMMENDED MEDIA

lawsuit-teen-suicide.html">Further reading on Sewell’s story

Laurie Segall’s interview with Megan Garcia 

v-Character-Technologies-Complaint-10-23-24.pdf">The full complaint filed by Megan against Character.AI 

Further reading on suicide bots 

Further reading on Noam Shazier and Daniel De Frietas’ relationship with Google 

The CHT Framework for Incentivizing Responsible Artificial Intelligence Development and Use 

Organizations mentioned: 

The Tech Justice Law Project

The Social Media Victims Law Center

Mothers Against Media Addiction

Parents SOS

together.org/">Parents Together

Common Sense Media

RECOMMENDED YUA EPISODES

When the "Person" Abusing Your Child is a Chatbot: The Tragic Story of Sewell Setzer

Jonathan Haidt On How to Solve the Teen Mental Health Crisis

AI Is Moving Fast. We Need Laws that Will Too.Corrections: Meetali referred to certain chatbot apps as banning users under 18, however the settings for the major app stores ban users that are under 17, not under 18.

Meetali referred to Section 230 as providing “full scope immunity” to internet companies, however Congress has passed subsequent laws that have made carve outs for that immunity for criminal acts such as sex trafficking and intellectual property theft.

Your Undivided Attention is produced by the Center for Humane Technology. Follow us on Twitter: @HumaneTech_

This episode currently has no reviews.

Submit Review
This episode could use a review!

This episode could use a review! Have anything to say about it? Share your thoughts using the button below.

Submit Review