hiw3c 日报精选
The Decoder 网页快照

METR警告称,AI进步速度远快于专家能够可靠测试新系统安全性之速度

原文标题 · AI is getting better faster than experts can reliably test whether new systems are safe, METR warns

METR报告称,像Opus 5.5和GPT-6 Astra这样的领先AI模型在研究任务上正快速进步,但衡量其表现却愈发困难。该组织警告称,现有数据无法排除AI发展出现危险的加速趋势,不过也指出常规测试可能高估了这些模型实际能达成的水平。METR警告的文章《AI的进步速度比专家可靠地测试新系统是否安全的速度更快》最初发表于The Decoder。

来源:The Decoder · the-decoder.com

正文为英文,可一键机器翻译(仅首次需要等待)

AI is getting better faster than experts can reliably test whether new systems are safe, METR warns

AI models are rapidly improving at AI research tasks, and they're getting harder to measure. According to the AI research organization METR , current public data isn't enough to rule out a drastic acceleration in AI research over the next few years. That could leave humans unable "to meaningfully understand, assess, and react to catastrophic risks posed by new AI systems," the organization warns.

On clearly defined coding and computational tasks with direct feedback, the models already beat experienced human professionals most of the time, METR found, though they haven't yet outperformed large groups of top experts. For tasks that take humans longer, the task length the models can handle doubles every 3.6 months. A naive extrapolation of METR's data puts them at a 50 percent success rate on the longest, 200-hour tasks by July 2027.

The systems still struggle with open-ended questions that lack immediate feedback and require real judgment, as well as with situations that are hard to recreate for training, according to METR. The organization also warns that common, easy-to-run tests may overestimate how well the models perform in real-world use, since developers train them in very similar test environments. Ad Ad

AI News Without the Hype – Curated by Humans

Every Plus article and the full archive

Frontier Radar: 6 deep dives a year

"Ask AI" with your Decoder subscription

Ask a question about the article or an AI topic. You can ask follow-up questions.