跳到正文
𝕏 ModelScope(x.com)·· 5 天前精選品質評分68
重點導讀

一般 AI 多半是等人提問後才回答,Duo 則想讓 AI 和人一起參與即時互動。

  • 它會持續聽對方說話、觀察對方的動作,再判斷何時該接話或等待,並同步產生語音和影片。
  • 這讓雙方能一起看物品、改變場景、接受引導或玩影音遊戲。
  • inclusionAI 也釋出多種模型版本,並提供研究用流程和即時部署方式。

AI 伴隨問答

自備 Key 深度分析

針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:

推薦理由

Duo 把即時影音互動中的理解、發言時機與影音生成串在一起,呈現模型如何參與雙向交流的研究方向。

ModelScope
ModelScope@ModelScope2022
·5 天前
𝕏

inclusionAI introduces Duo v1, its first implementation of a Reciprocal World Model, where the AI becomes a participant in a shared world instead of a system that only answers from outside it.
🤖 https://t.co/bVKRtvCL1z

🌍 A world that responds back: Duo is designed for full-duplex, real-time audiovisual interaction, continuously perceiving what a person says and does while generating its own audio and video responses.
🗣️ Knows when to join in: Its Intent module reasons over the ongoing interaction and decides whether to speak or wait, enabling more natural interruptions, timing, and turn-taking.
🎥 Makes interaction visible: The Realization module turns those decisions into synchronized video and stereo audio, supporting shared activities such as showing objects, reshaping scenes, guidance, and audiovisual games.
📦 Four released checkpoints: Duo 1.0 includes causal-base, distilled, and quantized variants; Duo 1.2 adds a causal-base checkpoint with improved generation quality.
⚡ Built for research and streaming: An offline pipeline is available for research, while vLLM-Omni and SGLang-Omni support accelerated real-time deployment.
📜 Code is released under Apache-2.0. Model weights follow the MiniMax H3 Community License.

推文來源 · X (Twitter)在 X 參與討論

讀者討論

理性交流 · 即時討論