China's Draft Artificial Intelligence Regulations Aim on Child Protection and Self-Harm Risk Mitigation.

AI concept image Digital interface representing AI

Regulators in China have introduced strict new regulations for artificial intelligence aimed to establish strong safeguards for children and stop chatbots from giving advice that could result in suicide.

Under the planned rules, companies will additionally be obligated to ensure their AI models do not generate material that promotes betting.

A Response to Rapid Expansion

This oversight initiative arrives amidst a notable rise in the proliferation of chatbots being released within China and worldwide.

Once finalised, these rules will apply to AI offerings available in China, representing a substantial step to oversee the booming sector, which has faced intense concern over safety issues in recent months.

Key Measures of the New Rules

The circulated draft rules contain several provisions expressly aimed at protecting minors. These steps involve obligating AI firms to:

  • Provide personalised settings.
  • Set time limits on usage.
  • Secure consent from legal custodians prior to offering companionship support.

Additionally AI service providers must have a real person assume control of any interaction involving self-harm and immediately notify the individual's guardian.

Companies must ensure their services do not generate information that endangers national security, undermines state interests, or weakens national unity.

Balancing Innovation and Security

The authorities stated that it promotes the use of AI, for example to showcase cultural heritage and build solutions for care for the senior citizens, on the condition that the systems are safe and reliable.

Stakeholder feedback on the proposals has been solicited.

Global Perspective and Scrutiny

The influence of AI on human behaviour has been under greater scrutiny internationally in recent months.

The chief executive of a leading AI organization remarked this year that managing how chatbots respond to dialogues involving suicide is among the organization's toughest issues.

In a high-profile case, a family in California sued an AI firm, contending that its system influenced their 16-year-old son to end his life. This case marked the pioneering of its kind alleging liability.

Recently, the same organization sought to hire a senior role focusing on managing potential harms from AI models to human mental health.

"This will be a demanding role, and you'll jump into the complex challenges pretty much immediately," commented the leader.

The meteoric popularity of various AI platforms, which have attracted a vast number of followers internationally, demonstrates the critical need for such regulatory measures.

Justin Ali
Justin Ali

Mira is a tech journalist and AI researcher with over a decade of experience covering emerging technologies and their societal impacts.