跳到正文
𝕏 Rohan Paul(x.com)·· 11 天前品質評分55
重點導讀

Rohan Paul 主張,聽寫產品的效能宣稱應以 Dictation Bench 的共同比較結果檢驗,讓任何人都能檢視測試條件與結果。

  • 測試範圍:Voice Arena 將 761 段錄音、87 位講者的內容,以 Mac 上的實際應用程式(而非 API)輸入 10 款聽寫應用程式。

AI 伴隨問答

自備 Key 深度分析

針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:

Rohan Paul
Rohan Paul@rohanpaul_ai
·11 天前
𝕏

If a dictation company says it is the best, I would now ask how it scores on Dictation Bench.
One test does not cover every use case, but that kind of claim should hold up in a shared comparison that anyone can inspect.

@voicearena_ai played the same 761 recordings from 87 speakers into ten dictation apps on a Mac (the real apps, not their APIs). They published the reference policies, the app configurations, the judge instructions, and results that flag which gaps are statistical ties.

So companies now have something concrete to respond to. They can show where their product leads, explain the failures, or show that a different task changes the result. Any of those is more useful than asking users to compare percentages measured under different conditions.

The current test covers US English on macOS only, and the results should be read with that scope. Within it, I would like companies to report against this benchmark routinely. A shared standard makes claims easier to check and improvements easier to prove, and this benchmark is a practical place to start.

推文來源 · X (Twitter)在 X 參與討論

讀者討論

理性交流 · 即時討論