跳到正文
𝕏 ModelScope(x.com)·· 12 天前品質評分58
重點導讀

Sophon-Realtime v1.1 為開放權重全雙工語音模型加入零樣本語音複製,可即時使用複製聲音對話。

  • - 將數秒語音片段放入 model/voices/ 並設定 voice 名稱即可使用,無須微調或重新啟動。
  • 支援單張 GPU。

AI 伴隨問答

自備 Key 深度分析

針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:

ModelScope
ModelScope@ModelScope2022
·12 天前
𝕏

Sophon-Realtime v1.1 from Adventists AI @BKJinAI adds zero-shot voice cloning to an open-weights, full-duplex voice model.

Drop a few seconds of someone's voice into model/voices/, set "voice" to its name, and talk to it in that voice in real time. No fine-tuning, no restart, one GPU. Barge-in and laughs still work, and a voice cloned from a clip in one language can speak another.

Available in the Tag and Flash builds on ModelScope. Live mode is a drop-in replacement for the OpenAI GPT-Live API, and an E2E build with 0.21 s to first audio is coming soon.

Please only clone voices you have permission to use. 🤖https://t.co/jkFd0JRhhW

推文來源 · X (Twitter)在 X 參與討論

讀者討論

理性交流 · 即時討論