GPT-6.2 Astra 和 GPT-6.2 Sol 在 LMSYS Arena 的 Code Arena: WebDev 實測中,都進入了「表現與花費都很有競爭力」的前緣位置。
- Astra 得到 1781 分、排名第 3,每項任務的中位花費是 $5.45,比前一版 GPT-6 Astra 低 42%。
- Sol 得到 1757 分、排名第 7,任務花費中位數是 $1.45,比 GPT-6.1 Sol 低 21%。Astra 比 Sol 高 24 分,Sol 的花費則低 73%。這些成績讓人能比較兩款模型在網頁開發任務中的表現與成本。
- AI 助理的分數預計稍後公佈。
AI 伴隨問答
針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:
Real-world Arena scores are in for GPT-6.2 Astra and GPT-6.2 Sol by @OpenAI in the Code Arena: WebDev, and both have landed on the Pareto frontier!
- #3 with 1781 pts: GPT-6.2 Astra (Max)
- #7 with 1757 pts: GPT-6.2 Sol (Max)
GPT-6.2 Astra: #3 with 1781 pts
- +18 pts vs previous variant GPT-6 Astra (Max)
- #1 in Consumer Product, compared with #4 for GPT-6 Astra
- Median cost per task: $5.45 vs. $9.46 for GPT-6 Astra, 42% lower
- Lands on Pareto frontier (see placement in thread)
GPT-6.2 Sol: #7 with 1757 pts
- +13 pts vs GPT-6.1 Sol (Max)
- Median cost per task: $1.45 vs. $1.84 for GPT-6.1 Sol, 21% lower
- Lands on Pareto frontier (see placement in thread)
6.2 Astra vs. Sol
- Astra scores +24 pts above Sol
- Sol’s median cost per task is 73% lower ($1.45 vs. $5.45)
Congrats to the @OpenAI team on this release. Agent score coming soon!