MBZUAI 基礎模型研究所(IFM)發布開放式物理智慧世界模型 PAN 2,讓AI 助理在採取行動前先推演可能發生的情況。
- - 兩種推理分工:概念推理由 LLM 判斷事件發展、時間順序與鏡頭移動,並寫成文字。
- 感知推理由從頭訓練的 29B 擴散模型將文字轉換為視覺內容。
AI 伴隨問答
針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:
PAN 2將語言模型的步驟規劃與擴散模型的視覺生成分工,並以多步任務結果呈現兩者結合的差異。
MBZUAI's Institute of Foundation Models (IFM) just released PAN 2, an open foundation world model for physical intelligence.
It's built towards simulative reasoning: letting an agent play out what happens before it acts.
It works with two kinds of reasoning, each with its own job:
> Conceptual: an LLM works out what happens, when, and how the camera moves, then writes it down as text.
> Perceptual: a 29B diffusion model, trained from scratch, turns that text into what you see.
Take the LLM out, and multi-step tasks fall apart: 8.7% of steps right, no plan finished. Getting the order of actions right is the LLM's job.
With both, PAN 2 gets 75.1% of steps right and finishes 34.0% of plans in full, the highest among the models IFM tested. Every step has to hold for a plan to work.
More details in the technical blog:
[1/1]