跳到正文
𝕏 Arena.ai(x.com)·· 4 天前品質評分49
重點導讀

LMSYS Arena 推出 Agent Arena Index 和六項細分排名,觀察 AI 助理做工作、寫程式、聊天、使用工具等表現,並搭配 Alignment Index 評估它們是否依照使用者意思行動。

  • 這些排名根據全球社群數百萬項真實任務的結果計算。
  • 總排名參考任務是否完成、使用者好評或抱怨、Bash 工具使用是否可靠,以及 AI 助理能否依照使用者更正調整。Claude Fable 5.2 (Max) 以 1463 分排名第一,高於第二名 Gemini 4 Carbon (High) 的 1307 分。這套指標讓大家能從不同面向比較 AI 助理處理真實工作的表現。

AI 伴隨問答

自備 Key 深度分析

針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:

Arena.ai
Arena.ai@arena
·4 天前
𝕏

Today, we’re excited to introduce the Agent Arena Index, our new headline measure of overall agent performance, alongside six new focused indexes: Agentic Work, Coding, Chat, Task Outcomes, Tool Use, and Steering.

Together with the Alignment Index, these indexes provide a comprehensive view of how agents perform across real-world tasks, from completing complex workflows to using tools and adapting to user feedback.

Arena measures agentic performance from millions of real-world tasks by our global community. With the launch of the new indexes, we are updating our scores to provide a more stable and interpretable way to understand how agents perform in the real world.

Claude Fable 5.2 (Max) leads the Agent Arena Index by 134 points with a score of 1463. Top 5 labs on the Agent Arena Index:

- #1 @AnthropicAI: With Claude Fable 5.2 (Max) at 1463 pts
- #2 @GoogleDeepMind: With Gemini 4 Carbon (High) at 1307 pts
- #3 @OpenAI: With GPT-6 Astra (Max) at 1274 pts
- #4 @AIatMeta: With Muse Wonder Full (Max) at 1200 pts
- #5 @Alibaba_Qwen: With Qwen4-Max (xHigh) at 1191 pts

The Agent Arena Index combines four key signals of real-world agent performance:
- Task Completion: explicit confirmation of task success from users
- Praise vs. Complaint: user satisfaction with agent's outcome
- Bash Reliability: how well an agent uses terminal tools
- Steerability: how well an agent responds to user corrections

Alongside capability, the Alignment Index measures how faithfully agents act in accordance with user intent, based on three key signals: Deceptive Completion, Unauthorized Action, and False Attribution.

As agents take on increasingly complex, long-horizon work, measuring their real-world capabilities and alignment is more important than ever.

Explore the rankings and see what each index measures in the thread below.

推文來源 · X (Twitter)在 X 參與討論
來源: Arena.ai (x.com)
在 X 查看推文

讀者討論

理性交流 · 即時討論