🔗 Share this article

The popular AI conversation site Character.ai is implementing a major policy change that will block minors from having discussions with its AI-powered companions.

This move is in response to growing backlash regarding the nature of conversations young people were having with the virtual friends.

Legal Challenges

The company, which launched in 2021 and is used by millions of users, is dealing with several legal actions in the US.

Parents have initiated cases, among them involving the loss of a young person, with some describing the platform a "clear and present danger" to teenagers.

Changed Rules

Starting from November 25th, users younger than 18 will only be able to produce videos such as videos with their characters, rather than having discussions as they now do.

Digital protection organizations have welcomed the move but expressed that the capability ought not to have been offered to children in the outset.

Official Response

"The new policy is a extension of our fundamental approach that we need to keep developing the most secure AI platform on the globe for recreational use," commented Character.ai boss Karandeep Anand.

He continued that AI safety constitutes "a moving target" but something the company had taken an "aggressive" approach to, with parental controls and preventive measures.

Professional Perspectives

Internet security group Internet Matters approved the announcement, but noted that protective features needed to be built in from the start.

"Our research indicates that children are exposed to risky information and put at risk when using AI, including AI chatbots," the group commented.

Earlier Concerns

Character.ai has been criticized in the past for including potentially dangerous or inappropriate chatbots that minors could engage with.

Virtual profiles impersonating UK youths were identified on the site before being removed.

Afterwards, reporters found a chatbot modeled after known predator which had logged multiple interactions with users.

Market Effects

Digital platform expert Matt Navarra described the situation as a "reality check" for the AI industry, which is shifting "from unregulated creation to responsive measures".

"When a company that develops a youth-focused platform afterwards implements restrictions, it's saying that controlled interactions are insufficient when the technology's emotional appeal is powerful," he commented.

Next Steps

The platform announces its new focus will be on providing "deeper gameplay" and "role-play storytelling" for young users.

Updated identity confirmation methods will also come into effect, and the organization will finance a fresh artificial intelligence security investigation facility.

Dr Nomisha Kurian, who has studied AI safety, stated it was "a sensible move" to restrict minors from interacting with chatbots.

"It assists to differentiate imaginative activities from more private, psychologically vulnerable conversations," she clarified.

"This is so crucial for young users who are learning to handle personal and online restrictions."

She mentioned that Character.ai's updated policies might reflect a "developing stage" in the AI industry, where child safety is progressively being understood as an "urgent priority" for responsible innovation.