AI 日报hiw3c.com

我们测试了 13 个答案验证器。仅计字符的基线击败了其中 8 个。

BestBlogs·AI 高分精选 www.bestblogs.dev 网页快照

We Tested 13 Answer Verifiers. A Baseline That Only Counts Characters Beat 8 of Them.

A head-to-head benchmark of 13 answer verifiers on 2,018 items shows a trivial length-and-formatting baseline beats 8 of them, and that the top-ranked system by AUC is not the one that most helps an agent in practice.