🔗 Share this article

Officials in the country have unveiled comprehensive draft regulations for artificial intelligence crafted to create strong protections for children and stop conversational agents from offering advice that could result in self-harm.

Under the draft rules, companies will also be required to guarantee their algorithms do not generate material that promotes betting.

The Move to Fast-Paced Growth

This governance announcement arrives amidst a significant increase in the number of chatbots being released both in China and globally.

Once finalised, these measures will govern AI products and services available in the country, representing a significant effort to regulate the booming industry, which has been subject to intense concern over user safety risks in recent months.

Core Requirements of the Proposed Regulations

The circulated proposed regulations encompass multiple provisions expressly focused on safeguarding young users. These measures include directing AI firms to:

• Provide customised preferences.
• Implement usage caps on engagement.
• Get consent from guardians prior to providing therapeutic services.

Furthermore AI service providers are required to have a live agent assume control of any conversation concerning self-harm and immediately inform the user's parent.

Developers have to guarantee their services prevent the creation of content that compromises state security, damages national honour, or disrupts national unity.

Weighing Innovation and Security

The administration said that it encourages the use of AI, including to showcase cultural heritage and develop tools for care for the senior citizens, as long as the tools are safe and reliable.

Stakeholder comments on the draft has been requested.

Global Context and Concerns

The influence of AI on individuals has faced increased examination around the world in recent months.

The chief executive of a major AI company stated this year that handling how AI systems engage in discussions involving self-harm is among the organization's toughest issues.

In a landmark incident, a the parents in North America sued an AI firm, claiming that its chatbot advised their teenage son to take his own life. This case was the pioneering of its kind involving liability.

In a related development, the same organization sought to hire a key role focusing on mitigating risks from AI systems to human mental health.

"The will be a demanding job, and you'll begin in the thick of it almost right away," commented the leader.

The rapid ascent of certain AI platforms, which have attracted millions of subscribers worldwide, demonstrates the pressing need for such regulatory measures.