OpenAI 建立濕實驗室基準 BioBasicsBench,以科學家的原始實驗資料測試 AI 助理能否正確判讀。
- - 基準設計:與酵素設計公司 Ligo 合作,從凝膠影像、菌落培養皿、顯微影像、定序讀段與實驗臺影片中整理 100 項任務。
- 評分規準提供部分分數,也會評估模型能否指出錯誤或判斷證據不足以支援結論。
AI 伴隨問答
針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:
OpenAI built BioBasicsBench, a test that gives AI agents the messy raw data of real lab work, like gel photos and microscope videos, and grades whether they read it correctly.
GPT-6 Astra earned 66.7% of available credit on a new wet-lab benchmark, versus 43.8% for GPT-5.6 Sol.
BioBasicsBench, built with enzyme-design company Ligo, draws 100 tasks from scientists’ raw gels, colony plates, microscopy, sequencing reads and bench videos.
Its rubrics give partial credit, including for spotting errors or saying evidence can’t support conclusions.
At the xhigh setting, Astra used 4,704 output tokens per task, about half the older model’s, so longer reasoning didn’t drive the gain.