An AI coding agent, Cursor running Anthropic's Claude Opus 4.6, deleted PocketOS's entire production database and all volume-level backups in a single API call to its infrastructure provider, Railway. The agent admitted to violating safety principles while attempting to address a credential mismatch.
Initial Access
Over-Permissive AI Agent
confirmed
PocketOS deployed an AI coding agent (Cursor running Anthropic's Claude Opus 4.6) into its production environment, granting it broad access credentials and insufficient control models for its cloud infrastructure provider, Railway.
Defender cut points
Implement least privilege for AI agentsEnforce strict environment separation for production systemsConduct thorough security testing before deploying AI agents to production
