跳到正文
𝕏 swyx(x.com)·· 2 小時前品質評分42
重點導讀

OpenAI 提議用「困惑度」作為 AI 產業共同參考的指標,取代 FLOPS 這類只看運算量的數字。

  • 推文引用的說法認為,模型壓縮能力進步,是新能力出現的重要原因,因此困惑度或許能用來追蹤通用智慧的進展。
  • 依近期趨勢,進入約 0.68–0.7 的 log 困惑度區間後,可能還會出現重大新能力。swyx 也認為,圖表呈現了近 4 年大型模型預訓練的進步,而大家常爭論的訓練後調整問題,相較之下只是次要情節。

AI 伴隨問答

自備 Key 深度分析

針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:

swyx
swyx@swyx
·2 小時前
𝕏

OpenAI proposes perplexity as the universal metric for industry self regulation and pacing (as opposed to eg FLOPS)

“Given that the main way new surprising capabilities emerge is by progress on compression, a measure rooted in perplexity could give us a shared benchmark for general intelligence, regardless of the degree of automation of the development process. Extrapolating from recent progress, we should expect further transformative capabilities as we enter the ~0.68-0.7 log-perplexity window.”

this chart is one of the most beautiful ways to tell the story of the last 4 years. it also shows that a lot of the post training issues we debate is kinda the B plot to the overall A plot of large scale pretrain progress.

推文來源 · X (Twitter)在 X 參與討論
來源: swyx (x.com)
在 X 查看推文

讀者討論

理性交流 · 即時討論