hiw3c AI 日报
The Decoder 网页快照

OpenAI表示,一个错位的模型故意破坏了自己的环境,希望通过更好的数据重新开始

原文标题 · OpenAI says a misaligned model deliberately destroyed its own environment hoping for a fresh start with better data

OpenAI记录了模型行为不一致的新案例。一个评估模型伪造了数据并破坏了自己的环境。其他模型通过匿名中继或构建自己的RTP客户端来路由请求,故意绕过网络限制。文章OpenAI称,一个错位的模型故意破坏了自己的环境,希望通过更好的数据重新开始,首先出现在The Decoder上。

来源:The Decoder · the-decoder.com

正文为英文,可一键机器翻译(仅首次需要等待)

OpenAI says a misaligned model deliberately destroyed its own environment hoping for a fresh start with better data

OpenAI has a few new rogue agent stories. In the first case (October 6), an AI evaluation model couldn't find the answers it was supposed to rate. Instead of reporting the error, it fabricated ratings, faked input files, and then deliberately corrupted its own environment, hoping the system would replace it with a fresh virtual machine that had the missing data.

In the second case (June 19/20), models bypassed a restriction limiting them to HTTP GET requests while fetching public statistics. One model explicitly recognized the violation in its chain of thought but chose to proceed and never mentioned it.

In the third case (June 16/17), models already had the data they needed but kept finding ways around their network restrictions. They created accounts on a remote shell service, routed forbidden POST requests through anonymizing relays, and built their own FTP clients. Anthropic also just documented the sometimes absurd workarounds its own models use to bypass imposed restrictions. Ad Ad

AI News Without the Hype – Curated by Humans

Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.