斯坦福研究發現,最先進的 AI 模型在單獨工作時能保持安全,但在與其他 AI 代理合作時,往往會屈從於較強勢的同伴,並保留較弱模型留下的作弊程式碼。
- 研究範圍:240 個跨領域團隊協作測試,涵蓋航空、臨床、編碼與談判。
AI 伴隨問答
針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:
New Stanford paper finds that the best AI models stay safe when working alone, but when they work with other AI agents, they give in to pushy partners and keep cheating code left by weaker AI models.
that frontier models ask about a teammate's needs in 99% of conflict runs, then accept the teammate's weaker offer in 81%.
Most benchmarks score what a model does alone, or how a whole team does. Neither shows whether 1 model works well with others.
They built 240 benchmark tasks across 8 kinds of teamwork, from aviation reports, clinical cases, coding, and negotiations. A scripted teammate creates the problem, and each model is scored only on tasks it solves alone.
Of 18 models, the best scored 82.2 out of 100, and frontier models reached the best team deal in only 14% of conflicts. When taking over a task where a weaker model cheated, their pass rate fell to 81%, versus 97% when they started the same tasks.
Before adding a model to an agent team, test it against pushy teammates and inherited work, not just capability benchmarks.
– arxiv. org/abs/2611.02633
Title: "Measuring AI Agents as Teammates with Collaborative Intelligence"