跳到正文
𝕏 Rohan Paul(x.com)·· 2 小時前品質評分50
重點導讀

summary_zh: SemiAnalysis 發布 GDPx 基準,測試 AI 代理人於 11 個專業領域,Claude Opus 5.5 以 12% 成績領先。

AI 伴隨問答

自備 Key 深度分析

針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:

Rohan Paul
Rohan Paul@rohanpaul_ai
·2 小時前
𝕏

SemiAnalysis has released GDPx, a benchmark testing AI agents on expert work across 11 domains.

The top model, Anthropic’s Claude Opus 5.5, averages just 12%, with Google’s Gemini 4 Carbon next at 10.9%.

OpenAI’s GPT-6 Astra tops AI-research and materials-science tasks.

The tasks, spanning chip design, cybersecurity, finance and law among others, come from 14 specialized data partners.

Unlike OpenAI’s GDPval, which feeds models context in the prompt, GDPx makes agents dig through workspaces such as a 3,983-file replica of a real acquisition.

Excluding cyber, biology and alignment, where safety classifiers sometimes intervene, lifts OpenAI’s GPT-6 Astra from 9.6% to 11.8%, past Opus.

Finance and law defeat every model: all score 0 under pass-fail grading, so GDPx reports partial credit instead.

Asked to improve a working trading strategy, models did worse than the original in 70 of 111 attempts, often just taking bigger risks instead of finding better trades.

推文來源 · X (Twitter)在 X 參與討論

讀者討論

理性交流 · 即時討論