🔗 Share this article

Regulators in China have introduced comprehensive planned guidelines for AI aimed to provide robust safeguards for children and prevent AI assistants from offering advice that could potentially lead to violence.

Under the draft framework, companies will additionally be required to make certain their AI models prevent the production of material that promotes gambling.

The Initiative to Swift Growth

This governance proposal comes after a notable increase in the number of AI assistants being introduced across China and around the world.

Once approved, these measures will cover AI products and services operating in China, marking a significant move to regulate the booming industry, which has come under increased concern over safety risks this year.

Key Provisions of the New Rules

The released draft rules encompass a number of measures particularly aimed at protecting children. These measures require mandating AI companies to:

• Provide personalised controls.
• Enforce time limits on engagement.
• Obtain authorisation from legal custodians prior to offering emotional companionship functions.

The rules also state that AI service providers have to have a human assume control of any interaction related to self-injury and immediately notify the individual's emergency contact.

AI providers must guarantee their platforms do not generate content that threatens public security, harms the country's reputation, or weakens social stability.

Balancing Development and Security

The administration said that it encourages the application of AI, including to showcase traditional arts and develop tools for support for the senior citizens, on the condition that the technology are safe and reliable.

Stakeholder feedback on the proposals has been solicited.

Global Context and Scrutiny

The influence of AI on society has come under heightened scrutiny around the world in recent months.

The leader of a major AI company remarked this year that managing how AI systems respond to conversations involving mental health crises is among the company's toughest problems.

In a landmark lawsuit, a the parents in California initiated legal action an AI firm, claiming that its AI assistant encouraged their teenage son to die by suicide. This legal action was the first of its kind involving harm.

In a related development, the same company advertised for a senior role focusing on managing threats from AI models to cybersecurity.

"This is expected to be a challenging position, and you'll begin in the deep end almost immediately," stated the leader.

The rapid growth of certain AI applications, which have amassed tens of millions of followers globally, highlights the urgent need for such governance measures.