Subquadratic 推出決策模型 SubQ Snap 1.2,在 Artificial Analysis Decision Index v2.1 得到 73 分,比前一版 SubQ Snap 1.1 的 68 分高 5 分,並與 Drex Max v1.1、GLiDE v1.2 並列領先。
- 每 1M 個輸入 token 仍收費 $0.04,也支援 384K token 的上下文視窗。進步最大的是 AA-Paperclip 和 AA-Symmetry,各增加 8 分。
- 在 AA-Paperclip 上,檔案全部答對的比例從 46% 升到 62%。不過,AA-Omniscience-Decision 和 HLE-MultiChoice 的改善來自模型更常不確定時選擇不回答,正確率並沒有提高。這表示總分變好,不代表每種題目都答得更準。
AI 伴隨問答
針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:
Subquadratic’s SubQ Snap 1.2 gains 5 points over SubQ Snap 1.1 on the Artificial Analysis Decision Index v2.1, and is tied with Drex Max v1.1 and GLiDE v1.2 as the leading decision model
SubQ Snap 1.2 is the latest decision model from @subquadratic. Pricing is unchanged at $0.04 per 1M input tokens, and it supports a 384K token context window.
Decision Index v2.1 updates AA-Symmetry to v1.1. AA-Symmetry measures whether a model keeps the same decision and confidence when a question changes in ways that should not matter. v1.1 moves the answer options into the state and rewords them with the same meaning.
Key takeaways:
➤ SubQ Snap 1.2 scores 73 on the Artificial Analysis Decision Index v2.1, up from 68 for SubQ Snap 1.1: Drex Max v1.1 (73) and GLiDE v1.2 (73) are within 0.1 points. The largest gains are on AA-Paperclip (+8 points) and AA-Symmetry (+8 points).
➤ The AA-Paperclip gain comes from more documents answered fully correctly: the all-pass rate rises from 46% to 62%, level with Drex Max v1.1 (63%) and GLiDE v1.2 (62%).
➤ The gains on AA-Omniscience-Decision and HLE-MultiChoice come from abstention, not accuracy: non-hallucination rates rise from 85% to 89% and from 46% to 55%. Accuracy is flat at 21% and 9%. On AA-Omniscience-Decision, SubQ Snap 1.2 attempts 29% of questions, down from 33%.