跳到正文
𝕏 Arena.ai(x.com)·· 10 天前品質評分52
重點導讀

LMSYS Arena 研究讓電腦操作代理程式直接與遊戲及應用程式互動的 Interaction-as-a-Judge 評估方式,並開源兩組代理程式追蹤資料集。

AI 伴隨問答

自備 Key 深度分析

針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:

Arena.ai
Arena.ai@arena
·10 天前
𝕏

Agents are demonstrating increasingly strong capabilities in recreating games and applications. One likely reason is their growing ability to directly interact with these applications.

We studied Interaction-as-a-Judge, a growing evaluation paradigm where computer-use agents directly interact with games and applications to improve evaluation.

Interaction-as-a-Judge improves:
- alignment with user preferences.
- a model’s ability to detect errors in games.
- downstream generation. We see improvements in inference-time scaling and the ability for interaction-only reinforcement learning.

It also scales with computer-use capabilities; the better the computer-use model and method, the better the judgments.

We’re also open-sourcing two agent trace datasets, ArenaWebdevPreferences and ArenaWebdevCorrectness, to help support future research. Dive into the thread to learn more.

推文來源 · X (Twitter)在 X 參與討論
來源: Arena.ai (x.com)
在 X 查看推文

讀者討論

理性交流 · 即時討論