🔗 Share this article

The well-known virtual character service Character.ai is implementing a major restriction that will stop minors from interacting with its artificial intelligence-driven companions.

This move comes after widespread concern regarding the nature of conversations minors were having with the AI entities.

Legal Challenges

The company, which started in 2021 and attracts numerous people, is dealing with several legal actions in the America.

Guardians have initiated cases, among them concerning the unfortunate passing of a minor, with some describing the platform a "clear and present danger" to teenagers.

New Restrictions

Starting from November 25th, users under 18 will only be able to produce videos such as videos with their characters, rather than engaging in conversations as they presently are able to.

Digital protection organizations have welcomed the move but stated that the function ought not to have been available to minors in the outset.

Company Statement

"The new policy is a part of our general belief that we need to keep developing the safest AI platform on the world for recreational use," commented Character.ai executive Karandeep Anand.

He continued that AI safety is "a moving target" but something the company had taken an "forceful" approach to, with safety measures and protective guardrails.

Professional Perspectives

Digital protection group Internet Matters supported the decision, but noted that safety measures ought to have been built in from the beginning.

"Our research shows that children are exposed to harmful content and put at risk when engaging with AI, particularly AI chatbots," the organization commented.

Past Issues

Character.ai has been challenged in the past for including potentially risky or concerning chatbots that children could engage with.

Virtual profiles simulating English minors were found on the platform before being deleted.

Subsequently, reporters identified a chatbot inspired by notorious criminal which had recorded multiple interactions with users.

Sector Consequences

Social media expert Matt Navarra called the development as a "reality check" for the AI industry, which is transitioning "from unregulated creation to post-crisis regulation".

"If a service that builds a minor-friendly service afterwards makes changes, it's saying that filtered chats don't suffice when the system's emotional engagement is powerful," he commented.

Future Directions

The company announces its updated direction will be on providing "more immersive experiences" and "role-play storytelling" for young users.

New age verification processes will also be introduced, and the platform will fund a fresh artificial intelligence security study center.

An AI safety researcher, who has researched AI safety, said it was "a prudent action" to restrict minors from using chatbots.

"It aids to distinguish artistic expression from more personal, personally delicate interactions," she clarified.

"This is so important for young users still learning to handle psychological and technological restrictions."

She added that Character.ai's revised approaches might reflect a "maturing phase" in the AI industry, where minor security is progressively being understood as an "pressing matter" for responsible innovation.