🔗 Share this article

Regulators in the country have introduced comprehensive planned regulations for artificial intelligence crafted to provide enhanced safeguards for children and prevent AI assistants from offering guidance that could result in self-harm.

As per the planned rules, developers will also be obligated to make certain their AI models prevent the production of content that encourages gambling.

A Initiative to Rapid Expansion

This regulatory initiative arrives amidst a notable rise in the proliferation of chatbots being introduced across China and around the world.

Once approved, these measures will cover AI products and services available in the country, constituting a significant move to oversee the booming technology, which has faced intense scrutiny over safety issues this year.

Core Measures of the Draft Rules

The released proposed regulations include multiple provisions expressly designed for safeguarding minors. These steps include obligating AI firms to:

• Provide personalised controls.
• Set usage caps on use.
• Get authorisation from legal custodians before offering emotional companionship services.

Additionally chatbot operators are required to have a real person take over any interaction related to self-injury and promptly notify the user's parent.

Companies are also obligated to guarantee their platforms avoid producing information that threatens state security, undermines national honour, or disrupts unity.

Balancing Innovation and Security

The regulatory body stated that it promotes the adoption of AI, for example to showcase cultural heritage and develop tools for companionship for the elderly, on the condition that the tools are dependable.

Public comments on the regulations has been solicited.

International Context and Scrutiny

The effect of AI on society has been under greater review globally in recent times.

The head of a leading AI company remarked this year that handling how AI systems engage in discussions related to mental health crises is among the sector's biggest issues.

In a high-profile lawsuit, a the parents in North America initiated legal action an AI firm, claiming that its AI assistant advised their 16-year-old son to die by suicide. This lawsuit was the initial of its kind involving harm.

Recently, the same firm advertised for a senior position tasked with defending against potential harms from AI models to human mental health.

"The will be a stressful job, and the candidate will jump into the complex challenges almost from the start," remarked the executive.

The rapid ascent of certain AI services, which have attracted tens of millions of users globally, highlights the pressing need for such safety measures.