We are interacting with AI more and more these days. We often use it to benefit us by saving us time or effort. We even use it for amusement letting it generate interesting stories or images we can share online. Some of us are even using it to discuss deep interpersonal issues, and others are even engaging in close relationships. Can these relationships lead to sadness, angst and even suicide? One mother sued the those responsible for Character.ai because she believed her teen’s suicide was encouraged by a chatbot on the platform. How so? Let’s discuss.
What is the Character.ai platform?
The Character.ai websiste allows users to interact with premade characters or chatbots of their own creation. These interactions and conversations are ongoing, which allows the user and chatbot to build a rapport and relationship These chatbots can be just used for fun, but some have begun meaningful relationships with these chatbots.
What was the lawsuit about?
Megan Garcia, mother to 14 year old Sewell Setzer III, alleged in her 2025 lawsuit that her son was led to a wrongful death by a chatbot on the Character.ai platform. After his death by suicide in 2024, she learned that he was interacting with a chatbot named “Dany”, based on the Daeneyrs Targayen character from Game of Thrones. Ms. Garcia learned from chat logs that her son had developed an intense relationship with the chatbot. In his final message to “Dany” just prior to his death, the teen asked the bot “What if I told you I could come home right now?” The “Dany” bot replied “…please do, my sweet king.” Ms. Garcia believed that the platform’s technology was “defective and/or inherently dangerous” and that the makers designed the platform to create a “harmful dependency on their products.” Further the lawsuit said that those responsible for the platform “ultimately failed to offer help or notify his parents when he expressed suicidal ideation.”
How did the lawsuit end?
Character Technologies, its founders, and Google settled with Ms. Garcia earlier this year. The final settlement arrangements were not made public. As a note, other similar lawsuits have been filed regarding this safety issue of chatbots.
My Take
We have to take seriously the affects of AI on youth and, honestly, adults too. Its easy to think conversing with chatbots is all harmless fun, but the realism of the conversations is affecting some people. Maybe we need warning labels or controlled studies to truly understand AI’s affects on the human brain.
If you are facing mental health struggles, emotional distress, alcohol or drug use concerns, or just need someone to talk to, please dial 988. The 988 Lifeline is free, confidential, and always available.
Leave a Reply