hiw3c AI 日报
arXiv cs.AI/CL/LG 网页快照

一项任务,多个接口:简单的跨接口一致性培训提高LLM代理的鲁棒性

原文标题 · One Task, Many Interfaces: Simple Cross-Interface Consistency Training Improves LLM Agent Robustness

作者:Artin Tajdini、Manpreet Kaur、Peng Qi|后训练将LLM代理的能力与其训练的接口绑定起来。对该接口的语义保留的扰动,例如重命名动作或更改符号,会使底层任务保持不变,但会使代理的表现变得更差。独立评分每个样本意味着接口随机化只会扩大这种依赖性从单个接口扩展到训练集成

来源:arXiv cs.AI/CL/LG · arxiv.org

正文为英文,可一键机器翻译(仅首次需要等待)

Computer Science > Machine Learning

Title: One Task, Many Interfaces: Simple Cross-Interface Consistency Training Improves LLM Agent Robustness

Abstract: Post-training binds the competence of an LLM agent to the interface it was trained on. Semantics-preserving perturbations of that interface, such as renaming an action or changing the notation, leave the underlying task unchanged yet make the agent worse at it. Scoring each sample independently means interface randomization only broadens this dependence from a single interface to the training interface distribution, so out-of-distribution perturbations still degrade the agent. We propose Cross-Interface Policy Regularization (CIPR), a self-supervised objective that replaces action names with uninformative identifiers and presents each training sample under two interfaces in which equivalent actions are identified by construction. CIPR penalizes the KL divergence between the action distributions induced under the two interfaces, so the policy behaves consistently across them. We evaluate CIPR in both supervised and reinforcement-learning post-training, where it improves robustness. On agentic function calling, held-out interface perturbations reduce the accuracy of a post-trained agent by nearly 25%, and CIPR recovers 10.5% while leaving accuracy on the unchanged interface intact.

Submission history

Access Paper:

Additional Features

Current browse context:

References & Citations

BibTeX formatted citation

Bookmark

Bibliographic and Citation Tools

Code, Data and Media Associated with this Article

Demos

Recommenders and Search Tools

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs .