跳到正文
𝕏 Rohan Paul(x.com)·· 16 天前品質評分53
重點導讀

OpenAI 建立濕實驗室基準 BioBasicsBench,以科學家的原始實驗資料測試 AI 助理能否正確判讀。

  • - 基準設計:與酵素設計公司 Ligo 合作,從凝膠影像、菌落培養皿、顯微影像、定序讀段與實驗臺影片中整理 100 項任務。
  • 評分規準提供部分分數,也會評估模型能否指出錯誤或判斷證據不足以支援結論。

AI 伴隨問答

自備 Key 深度分析

針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:

Rohan Paul
Rohan Paul@rohanpaul_ai
·16 天前
𝕏

OpenAI built BioBasicsBench, a test that gives AI agents the messy raw data of real lab work, like gel photos and microscope videos, and grades whether they read it correctly.

GPT-6 Astra earned 66.7% of available credit on a new wet-lab benchmark, versus 43.8% for GPT-5.6 Sol.

BioBasicsBench, built with enzyme-design company Ligo, draws 100 tasks from scientists’ raw gels, colony plates, microscopy, sequencing reads and bench videos.

Its rubrics give partial credit, including for spotting errors or saying evidence can’t support conclusions.

At the xhigh setting, Astra used 4,704 output tokens per task, about half the older model’s, so longer reasoning didn’t drive the gain.

推文來源 · X (Twitter)在 X 參與討論

讀者討論

理性交流 · 即時討論