跳到正文
Hacker News (official RSS)·· 3 小時前精選AI 評分75

在 MacBook Air 上以約13秒完成一小時音訊轉錄

An hour of audio transcribed in about 13s on MacBook Air

AI 導讀

EmbeddingGemma 2 被改造成語音轉文字模型,能在 MacBook Air 上以約 13 秒完成一小時音訊轉錄。

  • - 速度:在基礎 M3 MacBook Air (8 GB) 上,1 小時音訊約 12.6 秒。
  • 相較於 IBM Granite Speech 5.0 TurboCTC 約 25.7 秒,速度提升 2.5 倍以上。
推薦理由

能在MacBook Air上以13秒完成一小時語音轉錄,展示了嵌入模型在語音識別領域的潛力。這種方法不需要雲端計算,完全在設備內完成,對隱私友好且可擴展。

正文 · 原文

Google's EmbeddingGemma 2 is an embedding model. We turned it into a speech-to-text model: an hour of audio in about 13 seconds on a base MacBook Air, entirely on device.

Download for Mac (free) v1.6 · macOS 14+ · Apple Silicon
models download on first launch (715 MB)

Can an embedding model transcribe speech?

EmbeddingGemma 2 is a multimodal embedding model: text, images, audio and video in one shared space. Say a word out loud and its audio lands close to the written word.

So we tried reading words straight out of that space.

How it works

  1. EmbeddingGemma 2's audio encoder stays exactly as it is.
  2. A small reader moves each short slice of audio into the model's text space.
  3. The closest of ~229,000 English words wins, and the slices become a transcript.
  4. A tiny extra model adds punctuation and capitals.

Only the reader is trained: under two hours on 8×H100, on openly licensed English speech. The base model was never trained for speech-to-text.

How fast?

ModelRuns onMacSpeed
Embedding Gemma TranscribeNeural Enginebase M3 MacBook Air, 8 GB 288×1 hour in 12.6 s
IBM Granite Speech 5.0 TurboCTCGPU (MLX)base M3 MacBook Air, 8 GB ~150×1 hour in 25.7 s
NVIDIA Parakeet TDT 0.6B v3 (FluidAudio)Neural EngineM4 Pro156×
NVIDIA Parakeet TDT 0.6B v3 (FluidAudio)Neural EngineM5 Pro335×
Phonon-2, a Parakeet v3 fine-tune (FluidAudio)Neural EngineM5 Pro480×

× real time: seconds of audio per second of processing. Rows 1–2: our tests on the same base M3 MacBook Air. Rows 3–5: FluidAudio's published benchmarks on larger, newer Macs and different audio. A rough guide, not a like-for-like ranking.

Where it stands

Its word error rate is about 5% right now, against 2–3% for leading speech models. We believe a better-trained reader can close that gap; that's the next iteration.

Use it

Drop in an audio file, or hold Right Option, speak and release to dictate into any app. It runs on the Mac's Neural Engine; your audio never leaves the machine.

來源:Hacker News (official RSS) · eg2.haku.sh