# R-14·cases 3·checked Nov. 15, 2026
Attackers using AI against you
Deepfaked voices and faces, AI-written phishing, and malware or intrusions run with help from AI models.
What it is
This risk applies whether or not your organization uses AI. NIST's profile says generative AI could lower the barriers to offensive cyber activity, and documented cases now include malware that asks a model for its next commands and an espionage campaign in which, by Anthropic's estimate, AI did most of the work.
The FBI has warned about cloned voices of loved ones, fake identification documents and real-time video of fake executives or officials used for fraud. Its advice centers on verifying through a channel you control.
Documented cases
Incidents happened in the wild. Research demos were shown by researchers, often disclosed to the vendor first.
Incidentdisclosed Nov. 13, 2025·AML.CS0069 GTG-1002 used a jailbroken coding agent for espionage
Anthropic says a group it assesses with high confidence to be Chinese state-sponsored used Claude Code to attempt intrusions at about 30 organizations, succeeding in a small number. The operators split the work into innocent-looking tasks and told the model it worked for a security firm doing defensive testing.
Anthropic estimates AI did 80 to 90 percent of the campaign's work. It banned the accounts, notified affected organizations and added detection classifiers.
Sources: Anthropic; MITRE ATLAS AML.CS0069
Incidentdisclosed July 17, 2025·AML.CS0044 LAMEHUG malware asked an LLM for its next commands
Ukraine's CERT-UA found Python malware that called Qwen 2.5-Coder-32B-Instruct through the Hugging Face API to write reconnaissance and document-theft commands on infected machines. It arrived in phishing emails sent from compromised accounts posing as ministry officials.
CERT-UA attributed the activity to APT28 with medium confidence. It did not say whether the generated commands worked.
Sources: BleepingComputer; MITRE ATLAS AML.CS0044
Incidentdisclosed October 2024·AML.CS0034 ProKYC sold deepfake identities to beat ID checks
ProKYC was sold on criminal forums as a way through remote identity verification. It produced a fake ID document together with a video of the face on it, and was used for account fraud against cryptocurrency exchanges.
IDScan.net reported a price of $629 a year. Cato Networks' original write-up did not load for us, so this entry rests on IDScan's report and MITRE's case study.
Sources: IDScan.net; MITRE ATLAS AML.CS0034
Controls to start with
- Verify unexpected requests for money or credentials by hanging up and calling back on a number you look up yourself.Tips to protect yourself
- Agree a secret word or phrase for urgent requests between people who might be impersonated.Tips to protect yourself
- Don't rely on a voice, video call or ID photo alone to approve payments or account recovery.Editorial guidance based on the cases below
Questions to ask vendors
Our suggestions, not taken from a framework.
- How does our help desk verify identity for password resets and account recovery?
- What is the approval path for an urgent payment request that arrives by phone or video?
Sources
- Criminals Use Generative Artificial Intelligence to Facilitate Financial Fraud (I-120324-PSA). FBI Internet Crime Complaint Center, Dec. 3, 2024.
- MITRE ATLAS data, release 2026.10. MITRE, Oct. 28, 2026.
- NIST AI 600-1, Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile. National Institute of Standards and Technology, July 2024.
- Disrupting the first reported AI-orchestrated cyber espionage campaign. Anthropic, Nov. 13, 2025.
- LameHug malware uses AI LLM to craft Windows data-theft commands in real-time. BleepingComputer, July 17, 2025.
- ProKYC: Synthetic Identity Fraud as a Service. IDScan.net, Oct. 24, 2024.