跳到正文
𝕏 Rohan Paul(x.com)·· 3 小時前品質評分59
重點導讀

Lean 讓 AI 數學研究得到無可爭議的評分器,而 Science’s Last Exam (SLE) 為實驗科學提供類似評分機制。

  • SLE 覆蓋 113 個任務、9 個學科,評分時隱藏檢查,避免 AI 預先知情。

AI 伴隨問答

自備 Key 深度分析

針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:

Rohan Paul
Rohan Paul@rohanpaul_ai
·3 小時前
𝕏

Lean gave AI math a grader nobody can argue with, and empirical science is now getting its own version of that idea.

Science’s Last Exam (SLE), a benchmark, grades research agents on artifacts that can be opened and re-run, with checks that domain experts seal when each task is built.

Led by the US nonprofit AItonomy Foundation, the benchmark spans 113 tasks in 9 disciplines and grades submissions with checks hidden from agents.

Most AI science tests ask questions with known answers; SLE hands an AI agent a research goal, data and lab software, then checks its finished work with tests the agent never sees.

It scores AI hypotheses against studies published after the model’s training cutoff, so memory cannot help. DeepSeek V4.1 Flash led, with 21.28% of its hypotheses anticipating later research.

推文來源 · X (Twitter)在 X 參與討論

讀者討論

理性交流 · 即時討論