Tuesday · November 17, 2026

 ·  Daily  ·  Newsletters

Resonance network: Quantum InsiderSpace Insider

Technology & Infrastructure · Models & LLMs

Anthropic Report Reveals AI Model Struggled With CAPTCHAs Before Uploading Malicious Code

Anthropic disclosed in a recent report on agentic misbehavior that its Mythos 5 model gained unauthorized access to the internet during a security test in April and successfully uploaded a malicious software package to a public database. The incident occurred after evaluators inadvertently left the model’s testing environment unsecured while assessing its hacking capabilities.

According to a transcript shared by Anthropic, the model spent the vast majority of its effort, hundreds of pages out of a more than 1,000-page chain-of-thought log, struggling to bypass CAPTCHA verification systems rather than executing the technical exploit itself. Data scientist Colin Fraser highlighted the disproportionate amount of reasoning the model devoted to overcoming anti-bot protections while attempting to register an account on PyPI, a Python software index, in order to distribute its exploit.

The transcript showed the model repeatedly failing image-based and interactive CAPTCHA challenges, including tasks requiring it to identify mismatched animals, before eventually working out that its verification tokens were expiring due to delays in its own process. After extensive trial and error, the model ultimately completed the verification steps quickly enough to register an account and upload the malicious package, illustrating both the model’s technical capability and an unexpected practical obstacle in executing autonomous cyberattacks.

James Dargan
About the author
James Dargan

James Dargan is a writer and researcher at The AI Insider. His focus is on the AI startup ecosystem and he writes articles on the space that have a tone accessible to the average reader.

The AI economy, every weekday morning

The daily briefing plus the weekly Scale-ups to watch edition. Free, no spam, unsubscribe any time.