Annotation Queues | Introduction to LangSmith (8/12)
A LangSmith annotation queue exposes two customer conversations the judge misread, while tool traces reveal a separate bug in the pizza-order subtotal.
📌 One-Sentence Summary LangSmith 标注队列发现评估器误判了两条顾客会话,工具追踪还揭示了披萨订单小计中的另一处问题。 📝 Summary 课程对比了午餐班次 10 条会话的人工标注和在线情绪分。复核人员先统一标注说明,再用独立的反馈键保存人工结果。评估器给两条会话打了正向分,但顾客最终都没解决问题。这暴露出只看语气的规则遗漏了处理结果。另一轮排查沿工具调用追踪配送拒
来源:BestBlogs·AI 高分精选 · www.bestblogs.dev
A LangSmith annotation queue exposes two customer conversations the judge misread, while tool traces reveal a separate bug in the pizza-order subtotal.