We Tested 13 Answer Verifiers. A Baseline That Only Counts Characters Beat 8 of Them.
A head-to-head benchmark of 13 answer verifiers on 2,018 items shows a trivial length-and-formatting baseline beats 8 of them, and that the top-ranked system by AUC is not the one that most helps an agent in practice.