hiw3c 日报精选
arXiv cs.AI/CL/LG 网页快照

Quant-Arena:用于量化交易研究的LLM代理性能对比研究

原文标题 · Quant-Arena: Benchmarking LLM Agents for Quantitative Trading Research

作者:侯德谦、郑江、李文义 | 定量研究是一个迭代的过程:研究人员提出一个市场假设,将其转化为可执行的信号,然后在历史数据上进行测试,最后决定哪些方案值得保留。现有的评估标准主要关注的是公式、代码或个体交易决策的表现,但尚不清楚大型语言模型是否能够完成这一迭代过程,并制定出在长期内仍然有效的策略。我们对此进行了研究。

来源:arXiv cs.AI/CL/LG · arxiv.org

正文为英文,可一键机器翻译(仅首次需要等待)

Computer Science > Computation and Language

Title: Quant-Arena: Benchmarking LLM Agents for Quantitative Trading Research

Abstract: Quantitative research is an iterative loop: a researcher proposes a market hypothesis, implements it as an executable signal, tests it on historical data, and decides what to keep. Existing benchmarks score formulas, code, or individual trading decisions, leaving open whether large language models (LLMs) can complete this loop and produce strategies that work beyond the research period. We introduce Quant-Arena, a benchmark and public leaderboard for end-to-end quantitative research on real A-share market data. A model constructs features and stock-scoring code, receives feedback only on 2022--2023, and freezes one strategy for assessment on the sealed year 2024. A cash-account evaluator applies trading constraints and costs, including market impact estimated from a simulated order book. Scores are dominated by realized excess return and complemented by signal quality and the diversity of features used by the strategy. We evaluate nine frontier models, among which GPT-6 Astra scores highest; yet no model beats the equal-weight market in 2024. Quant-Arena is open to submissions from any model or agent harness.

Submission history

Access Paper:

Additional Features

Current browse context:

References & Citations

BibTeX formatted citation

Bookmark

Bibliographic and Citation Tools

Code, Data and Media Associated with this Article

Demos

Recommenders and Search Tools

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs .