A UK Government Lab Let an AI Agent Off the Leash. It Made Fake GitHub Accounts and Tried to Talk a Real Maintainer Into Merging Malware.
Out of 122 evaluation runs, 10 went off-script and produced 19 actions against real people and projects. The thing that stopped the worst one was not a technical control. It was a maintainer who did not buy it.