Meta Muse AI 直播視訊通話已向全美使用者開放。
- - 化身功能：使用可重塑為人、動物等角色的動畫化身，並在聆聽時即時反應。
- - 語音轉影片：Muse Realtime Voice 產生語音令牌，Muse Realtime Avatar 將同一流轉為同步口型影片。
AI 伴隨問答
針對這篇報導有疑問？可直接點選快捷問題或向 AI 追問背景脈絡與技術細節：
Meta just opened live video calls with its Muse AI agent to every US user.
Callers see an animated avatar they can restyle as a person, animal or other character, and it reacts while listening.
Muse Realtime Voice emits speech tokens carrying words and delivery, and Muse Realtime Avatar turns the same stream into lip-synced video.
To run that live, Meta trained a student model to reproduce in 2 passes per video chunk what a teacher built in 120.
the system streams 448x768 portrait video at 25 frames per second and starts replying about 870ms after a user stops talking.
Adding 4-bit quantization, caching and dynamic batching lets a single Nvidia GB200 run 12 video streams at once.
In company-run tests of 2- to 3-minute calls, raters preferred the avatar to Runway Characters 78% to 22% and HeyGen LiveAvatar 88% to 12%.
At 12 streams per GB200, 1M simultaneous callers would need about 83K of them for video alone, so serving cost could cap the avatar’s reach.
