重點導讀
Sophon-Realtime v1.1 為開放權重全雙工語音模型加入零樣本語音複製,可即時使用複製聲音對話。
- - 將數秒語音片段放入
model/voices/並設定voice名稱即可使用,無須微調或重新啟動。 - 支援單張 GPU。
AI 伴隨問答
針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:
ModelScope@ModelScope2022
·12 天前
Sophon-Realtime v1.1 from Adventists AI @BKJinAI adds zero-shot voice cloning to an open-weights, full-duplex voice model.
Drop a few seconds of someone's voice into model/voices/, set "voice" to its name, and talk to it in that voice in real time. No fine-tuning, no restart, one GPU. Barge-in and laughs still work, and a voice cloned from a clip in one language can speak another.
Available in the Tag and Flash builds on ModelScope. Live mode is a drop-in replacement for the OpenAI GPT-Live API, and an E2E build with 0.21 s to first audio is coming soon.
Please only clone voices you have permission to use. 🤖https://t.co/jkFd0JRhhW
推文來源 · X (Twitter)在 X 參與討論
來源: ModelScope (x.com)
在 X 查看推文