跳到正文
𝕏 Rohan Paul(x.com)·· 12 天前精選品質評分66
重點導讀

MBZUAI 基礎模型研究所(IFM)發布開放式物理智慧世界模型 PAN 2,讓AI 助理在採取行動前先推演可能發生的情況。

  • - 兩種推理分工:概念推理由 LLM 判斷事件發展、時間順序與鏡頭移動,並寫成文字。
  • 感知推理由從頭訓練的 29B 擴散模型將文字轉換為視覺內容。

AI 伴隨問答

自備 Key 深度分析

針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:

推薦理由

PAN 2將語言模型的步驟規劃與擴散模型的視覺生成分工,並以多步任務結果呈現兩者結合的差異。

Rohan Paul
Rohan Paul@rohanpaul_ai
·12 天前
𝕏

MBZUAI's Institute of Foundation Models (IFM) just released PAN 2, an open foundation world model for physical intelligence.

It's built towards simulative reasoning: letting an agent play out what happens before it acts.

It works with two kinds of reasoning, each with its own job:

> Conceptual: an LLM works out what happens, when, and how the camera moves, then writes it down as text.
> Perceptual: a 29B diffusion model, trained from scratch, turns that text into what you see.

Take the LLM out, and multi-step tasks fall apart: 8.7% of steps right, no plan finished. Getting the order of actions right is the LLM's job.

With both, PAN 2 gets 75.1% of steps right and finishes 34.0% of plans in full, the highest among the models IFM tested. Every step has to hold for a plan to work.

More details in the technical blog:

https://t.co/l6xKPmKT9k

[1/1]

推文來源 · X (Twitter)在 X 參與討論

讀者討論

理性交流 · 即時討論