China’s state security ministry warns AI could become ‘hidden weapon’ if misused
As artificial intelligence (AI) continues to transform industries and daily life in the digital era, China's Ministry of State Security on Wednesday reminded the public about the technology's potential to threaten national security if misused. In an article published on its official WeChat account, the ministry cautioned that AI tools, if exploited by malicious actors, could be used to fabricate disinformation, steal sensitive data, and incite ideological confrontation—turning them into a "hidden weapon" capable of undermining critical infrastructure and social stability.
The article highlights that AI-powered "deepfake" technology, combining deep learning with digital forgery, can intelligently generate realistic images, audio, and video through automated data processing. While widely used in film, gaming, and advertising to enhance virtual experiences, the technology also carries serious risks.
If misused, deepfakes can infringe on individual rights, disrupt social order, and threaten national security. Chinese national security authorities have uncovered instances where hostile foreign forces have used deepfake technology to produce fake videos aimed at misleading the Chinese public, stirring panic, and undermining social stability, posing a potential threat to national security.
According to public reports, a malfunction in an open-source library allowed some users of a foreign AI model to access chat titles - and in some cases, names and payment addresses - of other active users, resulting in a personal data breach. Without proper safeguards, such sensitive information could be exploited by foreign intelligence agencies for recruitment, subversion, or infiltration, creating potential risks to national security, said the article.
Moreover, AI algorithms are designed to reorganize, generate, and output knowledge. When biased data or deliberately manipulated algorithms are introduced, they can produce ideologically skewed content - becoming a powerful tool for anti-China hostile forces abroad to incite unrest. This risk is particularly acute during the early stages of sensitive social incidents, when public attention is high and emotions are volatile. In such moments, AI-generated rumors often exploit the information vacuum to spread false narratives, misleading public opinion and triggering serious disruption, said the article.
National security authorities have uncovered that certain Western countries and foreign actors are systematically operating large numbers of online accounts to flood social media with targeted viewpoints or emotionally charged content. By weaponizing topics such as gender conflict and labor disputes, they aim to infiltrate, discredit, and destabilize Chinese society, said the ministry.
At the conclusion of the article, the ministry emphasized that as AI technology brings both new opportunities and challenges, it is crucial to proactively assess emerging risks, enhance national security awareness, and strengthen individual vigilance. Only through joint efforts can a robust public defense line be built to safeguard national security, it said.