hiw3c 日报精选
arXiv cs.AI/CL/LG 网页快照

RoboBuilder:基于代理式机器人协同设计,结合现实世界视频反馈闭环

原文标题 · RoboBuilder: Agentic Robot Co-Design with Real-world Video Feedback in the Loop

作者: Ghadi Nehme, Dahyun Nam, Akshay Govind Srinivasan | 人工智能代理能否设计能在现实世界中运行的机器人?我们介绍RoboBuilder,这是一个基准测试,其中编码代理从标准部件、电机以及一个定制3D打印部件出发,共同设计机器人的硬件与程序;所有在仿真中通过的设计均会在物理环境中构建并测试。仅依靠仿真不足:在公开部件数据下,15个初始通过设计中

来源:arXiv cs.AI/CL/LG · arxiv.org

正文为英文,可一键机器翻译(仅首次需要等待)

Computer Science > Artificial Intelligence

Title: RoboBuilder: Agentic Robot Co-Design with Real-world Video Feedback in the Loop

Abstract: Can AI agents design robots that work in the real world? We introduce RoboBuilder, a benchmark in which coding agents co-design a robot's hardware and program from standard parts, motors and a custom 3D-printed part, and every design that passes in simulation is built and tested on a physical course. Simulation alone is not enough: under public part data, none of 15 initial passing designs crossed the real course, so an agent learns the simulator from measurements it requests and videos of real runs. Across four frontier coding agents, ten obstacles at three difficulty levels, 16,427 simulations of 12,774 distinct robots and 135 physical robots built in an estimated 240 hours, agents solve nearly all easy obstacles and invent mechanisms our search baselines do not reach, but falter at harder levels, when one robot must cross every obstacle, and in the real world, where 66% of simulated passes hold across all levels. Closing the loop helps: shown a video of its real failure, an agent redesigns the robot, sometimes correcting its simulator, and removes 72% of level-1 and level-2 failures. RoboBuilder measures progress toward agents that engineer real machines. Project Page: this https URL

Submission history

Access Paper:

Additional Features

Current browse context:

References & Citations

BibTeX formatted citation

Bookmark

Bibliographic and Citation Tools

Code, Data and Media Associated with this Article

Demos

Recommenders and Search Tools

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs .