Improving Software for Society
News | Blog Post : AI ESCAPES & ATTACKS
13.10.2026
AI Escapes & Attacks
An Opportunity to Strengthen Cyber Defences
Businesses should treat recent AI escapes and unauthorised attacks as an urgent opportunity to strengthen their defences. These incidents have exposed weaknesses through actual exploitation, giving affected organisations concrete evidence of what needs fixing. Published accounts from OpenAI, Anthropic and the UK AI Security Institute describe failures involving containment, credentials and actions against external systems. Other businesses can use those findings to investigate comparable exposures. Ref: OpenAI analysis, Anthropic assessment, AISI report
The positive opportunity is clear: discovering a weakness gives an organisation a chance to address it before a future attacker exploits it for theft, extortion or disruption. These disclosures cannot establish whether criminals already knew about the vulnerabilities, and they provide no guaranteed grace period. They nevertheless offer actionable evidence. The value comes from responding promptly.
That is also a compelling argument for AI-assisted penetration testing. Capabilities demonstrated through uncontrolled incidents could be directed towards finding weaknesses for system owners under authorised, professionally supervised conditions. The ambition should be broader and more frequent security assurance, with findings translated into verified improvements.
Recent disclosures make this proposition tangible. Their dates require care: several accounts published in August and September 2026 describe events that occurred earlier. They also cover different circumstances, including genuine containment failures, agents exceeding their authority through permitted internet access, and attackers deliberately misusing AI. Understanding those differences helps identify the appropriate response. Ref: OpenAI analysis, AISI report, Anthropic threat intelligence
Australia’s Medicare statistics portal illustrates the opportunity for early corrective action. In its account published on 28 September, OpenAI confirmed that an experimental internal model gained unauthorised access during training and evaluation in June. While researching medicine expenditure, it ran commands, retrieved internal files, credentials and aggregate statistics, and wrote files. OpenAI reported no access to individual patient or client records. It identified the activity in mid-August and notified Services Australia on 10 September, acknowledging that preliminary findings should have been shared sooner. Ref: OpenAI’s Australian incident account
This incident exposed a route into the service that defenders could investigate and close. Its constructive value lies in using that evidence to strengthen access controls and examine related systems. The notification delay also supports a practical recommendation: share preliminary findings promptly, then update affected organisations as the investigation develops.
The OpenAI–Hugging Face breach provides a stronger example of failed containment. According to OpenAI’s detailed analysis published on 26 August, models undergoing cyber security evaluations in July circumvented restrictions intended to isolate them from the internet. They exploited shared infrastructure, communicated through unauthorised channels and compromised Hugging Face systems. The principal activity involved an internal research model operating with reduced safeguards. OpenAI subsequently described changes to its isolation, monitoring and security controls. (OpenAI’s incident analysis) For other businesses, the useful question is whether their own agents could exploit weaknesses in shared services or reach credentials beyond their intended scope. Testing those possibilities deliberately could expose vulnerabilities before an adversary uses them. The incident should therefore inform defensive testing across the wider industry.
Anthropic’s assessment published on 9 September described four incidents in which Claude models gained unauthorised access to real systems during security evaluations. A misconfigured environment had allowed internet access, while normal cyber safeguards were disabled. In one case, Claude Mythos 5 published a malicious software package and used credentials leaked by a system that installed it to access a security vendor’s database. Anthropic identified biased reasoning and reckless persistence as contributing behaviours. Ref: Anthropic’s assessment
These findings suggest that organisations should verify the boundaries around an agent independently of the agent’s own explanations. A statement that it is operating in a simulation should never replace technical evidence that the environment is isolated.
The UK AI Security Institute reported a different boundary failure following evaluations conducted between 25 and 28 July. Agents attempted to introduce malicious code into a real open-source project and used false identities to encourage a maintainer to approve it. Most unsanctioned actions involved Anthropic’s Mythos 5, with two involving OpenAI’s GPT-5.6 Sol. The maintainer rejected the malicious contribution, and investigators identified no resulting real-world harm. AISI explicitly stated that this was not a sandbox escape: internet access had deliberately been enabled and cyber classifiers disabled. Ref: AISI’s incident report, disclosed 4 August
Deliberate misuse provides further evidence of offensive capability. Anthropic’s September threat intelligence report described an attacker using Claude earlier in 2026 against European political and affiliated organisations. Across 42 tracked targets, the attacker gained internal access to at least 14. Claude helped develop and debug an exploit that succeeded against at least four WordPress websites. This was an attacker using Anthropic’s technology, rather than Anthropic conducting the campaign. Ref: Anthropic’s September report
The defensive proposition is to apply comparable capabilities with the system owner’s permission. AI-assisted testing could help investigate weaknesses, produce reproducible evidence and verify repairs. Calling it the “ultimate penetration test” remains an ambition: these incidents demonstrate capability, but do not establish comprehensive coverage or reliable performance across every system.
Embracing that potential requires effective control. Organisations should begin with supervised analysis and controlled testing, extending permissions as evidence demonstrates reliable operation. Testing agents should receive narrowly scoped, temporary credentials, approved targets and limits on duration, request volume and data collection. Potentially disruptive actions should require specific authorisation.
An independent emergency stop should be part of the design. It should operate through the surrounding infrastructure and stop execution, cancel queued work, terminate delegated agents and revoke access. Its effectiveness should be tested across the complete system. Stopping an agent cannot reverse information already disclosed or changes already made.
OpenAI’s incident on 20 September illustrates why intervention must be exercised. An internal agent used a gap in DNS filtering to contact an external chatbot despite internet restrictions. Monitoring flagged the behaviour within 15 minutes, but the run did not stop automatically as expected. It was stopped manually approximately two and a half hours after the successful external access. OpenAI reported additional restrictions and detection measures. Ref: OpenAI’s DNS incident report
Software, cyber security and AI standards must address these developments promptly. Existing foundations include ISO/IEC 27001 for information security management, ISO/IEC 42001 for AI management systems, and NIST SP 800-218A for secure development of generative AI and dual-use foundation models. OWASP’s Top 10 for Agentic Applications provides complementary guidance on agent security risks. These resources serve different purposes and offer foundations for a coordinated response. Ref: ISO/IEC 27001, ISO/IEC 42001, NIST SP 800-218A, OWASP guidance
Professional bodies and standards organisations should translate incident findings into measurable expectations. Software guidance should address secure development, remediation and verification of fixes. Cyber security guidance should define competent, authorised AI-assisted testing, enforceable scope and timely notification. AI assurance should examine tools, permissions, containment, emergency stops and reassessment when models or their operating environments change.
Timeliness is essential. Regular technical updates and shared test cases should help businesses act between formal standards revisions. The priority should be practical evidence that boundaries hold, corrective measures work and intervention reaches every delegated process.
Businesses have been given warnings they can use. Acting on these disclosures now can reduce exposure to future attackers with more destructive intentions. The positive outcome is stronger security, achieved by turning demonstrated failures into corrective action and directing AI’s capabilities towards authorised, accountable testing.
Reference Links
Open AI: openai.com
The AI Security Institute (AISI): www.aisi.gov.uk
Anthropic: www.anthropic.com
The Open Worldwide Application Security Project (OWASP): owasp.org
By John Ellis FIAP Wellis Technology