一般模型要先生成文字再選答案,處理大量搜尋或推薦問題時可能比較慢。
- Karpo-Decision-31B 改用選項評分:每個選項對應一個程式碼,模型替程式碼打分,再從中挑出答案,因此不必生成文字。原文列出它在 Decision Index Full 得分 73.9,與 GLiDE 27B 並列 300 個模型中的第一名。
- 和 Jev 1.14 相比,中位處理時間是 95 毫秒,對方是 196 毫秒。作者認為,開放權重也適合需要大量相關性判斷的搜尋與推薦服務。
AI 伴隨問答
針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:
A new open source decision model just launched, and it ranks first out of 300.
Karpo-Decision-31B swaps decoding for a readout head: a single-token code per option, one score per code, a softmax over that question's options. Zero generated tokens, always a valid answer, and the page is shared across questions through branch attention.
Decision Index Full: 73.9, the top score, tied #1 of 300 with GLiDE 27B at 73.4. The base is Gemma 4 31B, yet it beats Google's Gemini Decision 1 on Amazon ESCI, 64.7% vs 58.7%, and New Yorker Caption, 90.5% vs 79.7%.
Against Jev 1.14 it runs 95 ms vs 196 ms median, and JevBench estimates about a fifth less per 1,000 decisions.
Open weights matter for search and recommendation teams, who need many relevance calls per query, and for personal agents that need a calibrated act-or-ask threshold.