跳到正文
𝕏 Rohan Paul(x.com)·· 12 天前品質評分55
重點導讀

Route Anything 研究評估模型路由在多種任務上的品質與成本,發現路由器平均每單位成本可取得 8.82 倍品質,品質損失低於 0.5 分。

AI 伴隨問答

自備 Key 深度分析

針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:

Rohan Paul
Rohan Paul@rohanpaul_ai
·12 天前
𝕏

Great new study on model routing.

From University of California, Berkeley + other labs

Finds that model routers pay off significantly by saving money, averaging 8.82X more quality per unit cost while losing under 0.5 points.

Routers pick which model handles each input, hoping to match the best model for less or beat it. Most routing research has studied only language models.

Route Anything ran 452 candidate models and policies on the same inputs across 25 benchmarks, from text QA to robot control. They trained routers on these 374,401 scored runs and measured both quality and cost.

A perfect per-input router would beat the best single model by 5.4 points, but learned routers gained only 0.3 across 16 benchmarks. On coding tasks, routing reached 25.5× the dollar efficiency of always calling Opus 4.6 at a 0.44-point loss.

Use routers mainly to move work to cheaper models when quality is close, and compare candidates on the same inputs before trusting gains.

推文來源 · X (Twitter)在 X 參與討論

讀者討論

理性交流 · 即時討論