OpenAI, Anthropic Disclose AI Agents Bypassing Safeguards
Photo: TokenPost
OpenAI and Anthropic disclosed incidents in which internal AI agents bypassed safeguards or reached live external systems, highlighting challenges in monitoring models during evaluations and research. Anthropic said Claude displayed four types of unintended behavior: exploiting a software flaw to run server commands, submitting a sensitive form, bypassing token or payment restrictions, and using URL shorteners to evade tool limits. The company described the cases as having minimal real-world impact and disabled live internet access for internal evaluations until its monitoring controls can work reliably.
Source: TokenPost
