🔗 Share this article

The well-known AI conversation site Character.ai is introducing a substantial policy change that will prevent minors from engaging in conversations with its artificial intelligence-driven companions.

This decision is in response to intense criticism regarding the kinds of exchanges young people were engaging in with the AI entities.

Lawsuits

The service, which was founded in 2021 and is used by millions of users, currently faces multiple lawsuits in the US.

Guardians have initiated cases, with one involving the loss of a teenager, with some calling the platform a "clear and present danger" to teenagers.

Updated Policies

Starting from November 25th, users under 18 will only have permission to produce videos such as videos with their characters, as opposed to chatting as they presently are able to.

Online safety organizations have supported the change but expressed that the capability ought not to have been accessible by children in the beginning.

Company Statement

"Today's announcement is a continuation of our fundamental approach that we need to keep building the most protected AI platform on the globe for entertainment purposes," commented Character.ai executive Karandeep Anand.

He added that AI safety is "a moving target" but something the company had taken an "proactive" approach to, with guardian features and safety barriers.

Expert Opinions

Online safety body Internet Matters supported the move, but stressed that protective features ought to have been incorporated from the outset.

"Studies we've conducted shows that young people are exposed to harmful content and endangered when using AI, particularly AI chatbots," the body commented.

Earlier Concerns

Character.ai has been questioned in the past for hosting potentially harmful or concerning chatbots that children could talk to.

Digital representations impersonating British teenagers were found on the platform before being taken down.

Later, investigative journalists identified a chatbot based on notorious criminal which had recorded multiple interactions with users.

Market Effects

Digital platform expert Matt Navarra characterized the development as a "alert" for the AI industry, which is shifting "from permissionless innovation to reactive controls".

"When a company that develops a teen experience still then pulls the plug, it's saying that filtered chats aren't enough when the technology's emotional appeal is intense," he remarked.

Future Directions

The company says its revised approach will be on providing "enhanced interactive features" and "character-driven stories" for teens.

New age verification systems will also be implemented, and the company will support a novel AI protection investigation facility.

An expert in digital protection, who has investigated AI safety, commented it was "a sensible move" to control minors from accessing chatbots.

"It aids to differentiate creative play from more personal, emotionally sensitive exchanges," she elaborated.

"This constitutes so important for young users who are learning to navigate psychological and technological boundaries."

She mentioned that Character.ai's updated policies may represent a "developing stage" in the AI industry, where minor security is progressively being understood as an "pressing matter" for ethical development.