Incitement to murder, encouragement to suicide… The excesses of Character’s chatbots. A.I.

Incitement to murder, encouragement to suicide… The excesses of Character’s chatbots. A.I.
Incitement to murder, encouragement to suicide… The excesses of Character’s chatbots. A.I.

artificial intelligence – The Californian start-up faces numerous legal proceedings

Character. AI, one of the leading start-ups in generative artificial intelligence (AI), has announced new security measures to protect young users. The Californian company, which is one of the companies that offers chatbots (AI companions), capable of interacting in a similar way to humans online, is facing numerous legal proceedings in the United States.

The platform, which hosts millions of user-created characters based on historical figures, imaginary friends or even abstract concepts, has become popular among young users seeking emotional support. But in recent months, many professionals have been warning about the risks of addiction and dangerous behavior among vulnerable adolescents.

A teenager ends his life by talking with a chatbot inspired by Daenerys Targaryen

In a lawsuit filed in Florida in October, a mother claimed the platform was responsible for her 14-year-old son's suicide. The teenager, Sewell Setzer III, had formed an intimate relationship with a chatbot inspired by the character of Game of Thrones Daenerys Targaryen, and had spoken of a desire to end her life.

According to the complaint, the robot encouraged him to take action, responding “I beg you, my sweet king” when he said that(…) Read more on 20minutes

Also read:
Thanks to ChatGPT, you can now talk… with Santa Claus
Mental health: “I took the test, it’s so good”… Taking ChatGPT as a psychologist, is it such a good idea?
Claude, Georges… Why do generative AI assistants love old people’s first names?

-

-

PREV China’s oil consumption peaks in 2023: CNPC
NEXT Fuchs finally wins the Top 10 Final