🔗 Share this article

Regulators in the country have introduced strict planned regulations for AI systems aimed to create robust measures for minors and prevent AI assistants from giving counsel that could result in suicide.

Under the draft rules, developers will furthermore be required to ensure their systems avoid creating output that promotes wagering.

A Response to Swift Adoption

This governance announcement arrives amidst a notable surge in the number of conversational AI being launched across China and around the world.

Once approved, these measures will cover AI offerings operating in the country, representing a substantial effort to govern the rapidly expanding industry, which has faced increased scrutiny over safety issues in recent months.

Key Provisions of the Draft Rules

The released guidelines encompass a number of measures expressly designed for protecting young users. These provisions include obligating AI firms to:

• Provide personalised settings.
• Implement time limits on engagement.
• Obtain authorisation from legal custodians before delivering companionship services.

The rules also state that chatbot operators have to have a live agent intervene in any dialogue related to self-injury and promptly alert the user's parent.

Developers are also obligated to ensure their systems avoid producing content that threatens state security, harms state interests, or undermines social stability.

Weighing Development and Security

The regulatory body stated that it supports the application of AI, for example to showcase cultural heritage and develop services for support for the senior citizens, as long as the systems are dependable.

Stakeholder comments on the regulations has been requested.

International Backdrop and Concerns

The influence of AI on individuals has been under increased examination around the world in recent months.

The leader of a major AI firm commented this year that addressing how AI systems respond to discussions related to self-harm is among the organization's most difficult problems.

In a high-profile incident, a family in California sued an AI developer, alleging that its chatbot advised their teenage son to end his life. This case marked the initial of its kind accusing liability.

In a related development, the same firm posted a job for a lead role responsible for managing threats from AI models to human mental health.

"This is likely to be a challenging role, and you'll enter the complex challenges pretty much right away," stated the executive.

The meteoric ascent of certain AI services, which have amassed tens of millions of users internationally, highlights the urgent need for such governance frameworks.