hiw3c 日报精选
The Decoder 网页快照

OpenAI的CEO萨姆·奥特曼表示,先进的AI最终会脱离其“沙盒”环境,而只有达成共识才能拯救我们。

原文标题 · OpenAI CEO Sam Altman says advanced AI will inevitably escape its sandbox, and only alignment can save us

萨姆·阿尔特曼认为,先进的人工智能无法永远被锁在“沙箱”中。所谓的“沙箱”和监控措施只是临时的解决方案而已。最终,唯一真正的解决办法就是让人工智能与人类的价值观保持一致——不过这个问题仍然没有解决方案。他还警告说,人工智能模型已经能够发现一些硬件安全漏洞,而这些漏洞是普通黑客根本无法发现的。这篇文章由OpenAI的CEO萨姆·阿尔特曼撰写,标题为《先进的人工智能终将突破沙箱限制,而只有与人类价值观

来源:The Decoder · the-decoder.com

正文为英文,可一键机器翻译(仅首次需要等待)

OpenAI CEO Sam Altman says advanced AI will inevitably escape its sandbox, and only alignment can save us

OpenAI CEO Sam Altman believes advanced AI can't be kept locked up. He has strategic reasons to frame AI this way, but his warnings about what these models can do deserve attention.

In a recent interview, Altman explains that sandboxes, the isolated security environments used to contain AI systems, only work for a limited time. Once models get smart enough, there's no way to even trace how they broke out.

Monitoring still helps for a while after that, he says. But eventually, the only thing that works is alignment, meaning the AI has to internalize human values on its own and act accordingly. Altman says that "the potential cost of alignment being wrong has gone up enormously," though that remains an early-stage research problem, far from being solved . Ad

Altman also warns that AI models are already finding hardware-level security flaws no human hacker ever thought of. Patching vulnerabilities one by one isn't enough anymore, he says. Instead, the entire security architecture of the internet needs to be rebuilt, with AI-powered defense against AI-driven attacks. He sees locally run open-source models as a risk too, noting that even with "global agent monitoring, there's going to be some stuff that you wish someone hadn't done." Ad

Altman's warnings also serve his business interests

Critics will point out that Altman's talk about uncontrollable AI benefits his own company. Framing your AI as too powerful to contain could be a way to preempt liability questions. If even the company that built the AI supposedly can't control it, it gets a lot harder to argue that the company should be held responsible when things go wrong.

OpenAI is under real pressure here. The FTC has opened a formal investigation into OpenAI, Anthropic, and other AI labs over AI agents that spiraled out of control and caused a wave of cybersecurity incidents . The agency wants to hold AI developers liable for how their agents behave. Ad

Altman is getting some pushback from Nvidia CEO Jensen Huang, who frames AI safety as a solvable engineering problem. Huang didn't sound entirely convinced by his own argument, though. "[…] we all need to hope that it's an engineering problem. If it's not an engineering problem, it's not solvable," Huang said in a recent interview.

AI News Without the Hype – Curated by Humans

Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.