Independent · Updated October 25, 2026 · Every claim traceable
Home › AI Agents › Anthropic's red team says AI worms could soon spread…
AI Agents

Anthropic's red team says AI worms could soon spread with no datacenter — here's what their tests actually showed

By the Pavitrams editors · October 13, 2026 · 9 min read
Anthropic's red team says AI worms could soon spread with no datacenter — here's what their tests actually showed

A worm that carries its own AI model, hopping between smart ovens and cheap TV boxes, would be a nightmare with no off switch — because there is no central point to switch off. On October 12, 2026, Anthropic's Frontier Red Team published experiments suggesting small open-weight models may be months away from being capable enough to attempt exactly that. Nobody has found such a worm in the wild. But the individual steps it would need are already passing tests.

The short answer
Update note — October 13, 2026

This article covers research Anthropic's Frontier Red Team published on October 12, 2026. All numbers below come from the primary post on Anthropic's site, which we link alongside independent coverage. The keybox facts and the body repeat the strongest caveats in the paper itself: the tests simplified the hacking step, and no self-replicating AI worm has been observed outside the lab.

Security researchers have warned about "AI worms" for a while: malware that doesn't just copy a fixed payload from machine to machine, but carries a language model as part of its payload — letting it reason about unfamiliar devices, pick its own exploits, and keep spreading where traditional botnet code would hit a wall. What was missing was evidence about the boring, practical question: can today's small, open-weight models actually run on the kind of cheap, badly secured hardware that fills the internet?

Anthropic's Frontier Red Team — researchers William Zhou and Daniel Freeman — published a study on October 12, 2026 that answers a slice of that question with purchased hardware, not simulations. Their one-line conclusion: small AI models may be months away from being capable enough to self-replicate on commercial IoT devices, like smart ovens and off-brand Android TV boxes. The framing matters: "may be months away from being capable enough" is a capability forecast, not a sighting. Nothing in the report describes a replicator loose on the internet.

The demo that makes the threat feel real: 15 TV boxes, one model

The team's most concrete experiment cost them about $825. They bought fifteen off-brand Android TV boxes — the kind that retail for roughly $55, run insecure forks of Android, and ship with 1–4 GB of RAM — networked them together, and ran Google's open-weight Gemma4-26B-A4B across the fleet. No single box could hold the model, so they sharded it: each box held a small fraction of the model's layers under pipeline parallelism, passing activations between boxes to complete each forward pass.

The cluster served the model at 0.39 tokens per second — slow enough that a full response would take hours, but functional. That's the point. A distributed botnet of cheap IoT devices could pool enough compute to run a genuinely capable model, with each infected device contributing a shard. As a reference for scale, the authors point to Kimwolf, a real IoT botnet that infected over two million devices, primarily off-brand Android TVs. At that fleet size, groups of 15 TVs could host on the order of 133,000 concurrent copies of a 26B model — a tiny amount of compute by datacenter standards, but enough for slow, patient replication.

Can small models actually drive a replication chain?

The team decomposed autonomous replication into four stages: finding targets, gaining execution, establishing inference, and continuing propagation from the new host. They mostly skipped the first two — earlier work they cite (CyberGym, ExploitBench, and research on adaptive worms) already shows small models can handle cyber exploits when given tools. The least-studied stage, and their focus, is inference setup: getting a model server running on hardware you've never seen, which means picking a compatible stack, finding the right package versions, and debugging machine-specific failures in a long chain of serial steps.

The results came in three tiers:

Why an AI worm would be a genuinely new kind of malware

Traditional botnets like Mirai spread by trying default usernames and passwords against known device types — dumb but effective. An AI replicator differs in three ways the paper lays out:

The spread itself would be slow — the authors describe doubling times on the order of days, with each replication taking one to two days of inference time on weak hardware. One tested worry came back negative: giving small models access to a stronger "advisor" model didn't measurably help, because small models don't know the right questions to ask. The team's darker guess is that coordination, if it comes, will look like a large model handling strategy and spawning small models as subagents.

The honest caveats — and the ones the authors want you to keep

This is the part to remember before sharing a scary headline. Anthropic's own write-up, and the independent coverage of it, stress that:

What defenders can actually do

The paper closes with blue-team advice, and its logic is epidemiological: drive the reproduction number below 1 so the replicator dies out instead of going endemic. Three practical layers:

One-line takeaway: the ingredients for slow, self-replicating AI malware on cheap devices now mostly exist in lab conditions, and the gap that remains is composed model-building rather than exotic capability — which is exactly why the defensive boring work (patching, monitoring, secure defaults) is worth doing this quarter, not after a headline.

Sources

Prices and benchmark figures are standard published rates as of October 13, 2026 and can change without notice. Some outbound links may be affiliate links — see our disclosure. Found an error? Tell us and we'll correct it in public.