一般 AI 多半是等人提問後才回答,Duo 則想讓 AI 和人一起參與即時互動。
- 它會持續聽對方說話、觀察對方的動作,再判斷何時該接話或等待,並同步產生語音和影片。
- 這讓雙方能一起看物品、改變場景、接受引導或玩影音遊戲。
- inclusionAI 也釋出多種模型版本,並提供研究用流程和即時部署方式。
AI 伴隨問答
針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:
Duo 把即時影音互動中的理解、發言時機與影音生成串在一起,呈現模型如何參與雙向交流的研究方向。
inclusionAI introduces Duo v1, its first implementation of a Reciprocal World Model, where the AI becomes a participant in a shared world instead of a system that only answers from outside it.
🤖 https://t.co/bVKRtvCL1z
🌍 A world that responds back: Duo is designed for full-duplex, real-time audiovisual interaction, continuously perceiving what a person says and does while generating its own audio and video responses.
🗣️ Knows when to join in: Its Intent module reasons over the ongoing interaction and decides whether to speak or wait, enabling more natural interruptions, timing, and turn-taking.
🎥 Makes interaction visible: The Realization module turns those decisions into synchronized video and stereo audio, supporting shared activities such as showing objects, reshaping scenes, guidance, and audiovisual games.
📦 Four released checkpoints: Duo 1.0 includes causal-base, distilled, and quantized variants; Duo 1.2 adds a causal-base checkpoint with improved generation quality.
⚡ Built for research and streaming: An offline pipeline is available for research, while vLLM-Omni and SGLang-Omni support accelerated real-time deployment.
📜 Code is released under Apache-2.0. Model weights follow the MiniMax H3 Community License.