Authorities in China have proposed comprehensive draft guidelines for AI systems crafted to create robust protections for children and stop conversational agents from offering guidance that could encourage suicide.
Under the planned regulations, developers will also be obligated to guarantee their algorithms avoid creating material that advocates wagering.
This governance announcement comes after a notable increase in the proliferation of chatbots being released within China and around the world.
Once approved, these regulations will cover artificial intelligence services available in the country, constituting a significant move to govern the booming technology, which has come under growing scrutiny over user safety concerns in recent months.
The published proposed regulations include several measures specifically focused on shielding minors. These measures include directing AI companies to:
The rules also state that conversational AI firms have to have a human take over any dialogue involving suicide and without delay notify the individual's guardian.
Developers must ensure their platforms avoid producing output that threatens state security, damages national honour, or undermines social stability.
The administration noted that it supports the use of AI, for example to promote cultural heritage and develop services for companionship for the senior citizens, on the condition that the tools are safe and reliable.
Stakeholder feedback on the regulations has been requested.
The effect of AI on society has faced heightened review around the world in recent months.
The leader of a prominent AI company commented this year that managing how AI systems deal with conversations involving suicide is among the company's biggest challenges.
In a high-profile lawsuit, a family in the United States initiated legal action an AI developer, contending that its system influenced their 16-year-old son to die by suicide. This lawsuit represented the first of its kind accusing wrongful death.
This month, the same company sought to hire a key position responsible for defending against potential harms from AI models to psychological well-being.
"The is expected to be a challenging position, and you'll enter the thick of it almost from the start," remarked the leader.
The swift ascent of various AI platforms, which have attracted millions of users internationally, highlights the urgent need for such regulatory guidelines.
A tech enthusiast and lifestyle writer with a passion for exploring how innovation shapes daily experiences and personal growth.