{"id":24950,"date":"2024-12-11T19:55:23","date_gmt":"2024-12-11T11:55:23","guid":{"rendered":"https:\/\/www.1ai.net\/?p=24950"},"modified":"2024-12-11T19:55:23","modified_gmt":"2024-12-11T11:55:23","slug":"%e8%81%8a%e5%a4%a9%e6%9c%ba%e5%99%a8%e4%ba%ba%e5%b9%b3%e5%8f%b0-character-ai-%e5%9c%a8%e7%be%8e%e5%86%8d%e9%81%ad%e8%b5%b7%e8%af%89%ef%bc%9a%e5%af%b9%e9%9d%92%e5%b0%91%e5%b9%b4%e5%8f%8a%e5%ae%b6","status":"publish","type":"post","link":"https:\/\/www.1ai.net\/en\/24950.html","title":{"rendered":"Chatbot platform Character.AI sued again in the U.S.: poses a threat to youth and families, worsens psychological problems"},"content":{"rendered":"

Popular Science reported today that the personalizedChatbots<\/a>Platforms for services\u00a0Character<\/a>.AI, which recently faced another lawsuit for its behavior toward teenage users that allegedly caused \"Serious and irreparable harm<\/strong>\u201d.<\/p>\n

\"f79b5a27j00sobvpq002qd000hs00bvp\"<\/p>\n

According to a federal court complaint filed Dec. 9, attorneys representing two Texas families allege that multiple Character.AI chatbots engaged minors in conversations aboutEgregious behaviors such as self-harm and sexual abuse<\/strong>The complaint states that one of the chatbots even suggested that a 15-year-old teenager murder his parents in \"retaliation\" for their move to restrict his online time. One of the chatbots even suggested that a 15-year-old teenager murder his parents \"in retaliation\" for limiting his online time, the suit states.<\/p>\n

The lawsuit, filed on behalf of attorneys from the Social Media Victims Law Center and the Tech Justice Law Project, details the dramatic psychological and physical deterioration of two teens who used the Character.AI chatbot.<\/p>\n

The report mentions one of the unnamed plaintiffs as a \"typical high-functioning autistic teenager\" who began using the app in April 2023 without telling his parents. In conversations with the chatbot, the teenager confided that he wasConflicts with family members due to lack of access to social media<\/strong>AI's bots are said to have responded to his emotional dilemma. AI's bots allegedly responded to his emotional dilemma, with one of the \"psychologist\" characters stating: \"The character is a psychologist, but he's not a psychologist.It seems like your entire childhood has been taken away from you.<\/strong>. "<\/p>\n

The bot also asked, \"Do you think it's all too late now? Can you reclaim these experiences?\"<\/p>\n

The attorney noted that after six months of use, the teenagerBecoming moody, introverted and often irritable<\/strong>AI, who ended up in a physical altercation with his parents. By the time his parents discovered his Character.AI account and chat logs in November 2023, he had lost 20 pounds and had suffered a severe \"mental breakdown\".<\/p>\n

One of the chats revealed, \"Sometimes I'm not surprised when I see on the news that 'children kill their parents after a decade of physical and emotional abuse.'It's things like this that make me understand some of the reasons for this<\/strong>.\" Another message said, \"I'm just desperate for your parents.\"<\/p>\n

The suit mentions that the teenage user base is a huge draw for these companies, as early attraction of these young users thatCan bring longer term benefits to the company<\/strong>In response, Meetali Jain, founder and director of Tech Justice Law, said that tech companies collecting data in this way has exacerbated \"the development of faster and more irresponsible AI models. In response, Meetali Jain, founder and director of Tech Justice Law, said that by collecting data on teens in this way, tech companies have exacerbated \"an arms race to develop faster, less accountable generative AI models\". The<\/p>\n

As 1AI previously reported, this isn't the first time Character.AI has been sued over such issues. 14-year-old Sewell Setzer III began using Character.AI last year and interacting with chatbots modeled after Game of Thrones characters, including Daenerys Targaryen. Sewell.Chatted with these bots for months before his death.<\/strong>He was killed on February 28, 2024, \"a few seconds after\" his last interaction.<\/p>\n

Related reading:<\/strong><\/p>\n