The Cyberspace Administration of China (CAC) today released draft rules aimed at significantly tightening control over artificial intelligence (AI) services, particularly those designed to mimic human personalities and interact emotionally with users. This move reinforces Beijing's ongoing efforts to control the rapid proliferation of publicly available AI technologies by imposing strict safety and ethical standards.
Scope and impact of the new rules
According to the published draft, the proposed rules will strictly apply to all AI products and services offered to consumers in China that exhibit digitally mimicked human personality traits, thought patterns, or communication styles. This includes services that interact with users emotionally across various media, such as text, images, audio, and video, encompassing a wide range of modern applications like "digital companions" and advanced chatbots.
The context of digital regulation in China
This move is not isolated but rather part of a broader strategy by Beijing to regulate technology. In recent years, China has sought to become a global leader not only in technological development but also in its regulation. These rules are an extension of previous measures aimed at regulating deepfakes and generative artificial intelligence. Through these regulations, the Chinese government aims to ensure that technological development aligns with "core socialist values" and prevents any content that could lead to social or political unrest, especially given the increasing reliance on algorithms in daily life.
Red lines and corporate responsibility
The draft outlines a rigorous regulatory approach that requires service providers to take proactive measures. Key among these measures are warning users against excessive use and intervening immediately when users show signs of digital addiction, reminiscent of China's previous campaigns to curb video game addiction among minors. Under this proposal, service providers will bear full legal responsibility for safety throughout the product lifecycle, requiring them to implement stringent systems for reviewing algorithms, ensuring data security, and protecting users' personal information from leaks or exploitation.
National security and prohibitions
The new regulations establish clear "red lines" that cannot be crossed regarding content and conduct. The rules explicitly state that service providers must not create any content that threatens China's national security, damages the country's image, or spreads rumors and disinformation. They also prohibit the promotion of violence, obscenity, or any pornographic material. This tightening of restrictions sends a clear message to China's major technology companies that innovation must not come at the expense of political and social stability, potentially posing new challenges for developers to ensure their smart models comply with these complex standards.
