AI-Generated Malware Evading Cybersecurity Defenses May Already Exist, Warn Experts

The UK’s cybersecurity agency has issued a warning that AI-generated malware capable of eluding detection might already be at the disposal of nation-states. To create such potent software, threat actors must train an AI model using high-quality exploit data, according to the National Cyber Security Centre (NCSC). This AI system would then generate new code that bypasses existing security measures.

The NCSC cautioned that there is a real possibility that highly capable states possess extensive repositories of malware, allowing them to effectively train AI models for this purpose. While the term “realistic possibility” may leave some room for interpretation, the agency’s “probability yardstick” offers some clarity.

This warning is part of a series of concerns raised by the NCSC. The agency anticipates that AI will amplify the global ransomware threat, enhance the targeting of victims, and reduce the entry barrier for cybercriminals.

Generative AI, in particular, is contributing to these threats. It proves valuable for social engineering tactics, such as crafting convincing interactions with victims and generating lure documents. GenAI is making it increasingly challenging to identify phishing attempts, spoofing, and malicious email or password reset requests. However, nation-states are expected to wield the most formidable cyber weapons.

The agency stated that highly capable state actors are likely the best equipped among cyber threat actors to harness AI’s potential in advanced cyber operations. In the short term, AI is projected to augment existing threats rather than undergo a transformation of the risk landscape. Experts are particularly concerned about the escalating global ransomware threat.

James Babbage, Director General for Threats at the National Crime Agency, emphasized that ransomware continues to pose a national security threat. He highlighted that advancements in AI and its exploitation by cybercriminals are expected to contribute to an increased threat in the coming years, as indicated in the report.