跳到正文
𝕏 Rohan Paul(x.com)·· 8 天前品質評分47
重點導讀

大型語言模型會猜文字裡最常接著出現的內容,但常見的說法不一定是真的,少見的真事也可能被模型低估。

  • Meta 的這篇論文提出,可以讓模型換幾種觀點回答同一個問題,再看答案有哪些地方都相同。
  • 如果完全沒有共同答案,就先不要作答。論文用例子說明,答案看起來有多可能,和它是不是真的不一定相同:在一個只有兩種答案的例子裡,loss 0.67 對應 100% 正確,接近的 0.71 卻對應 0%。這只是論文中的例子,沒有實際實驗。
  • 它提醒我們,信任 AI 答案前,可以換個說法、角色或語言再問一次。

AI 伴隨問答

自備 Key 深度分析

針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:

Rohan Paul
Rohan Paul@rohanpaul_ai
·8 天前
𝕏

Such a simple yet powerful idea in new Meta paper.

Says that likelihood is the wrong test of truth for LLMs, and that answers which stay the same across contexts deserve more trust.

that LLMs are trained to predict the most likely next token, so they learn what is common in text, not what is true. A falsehood repeated often in training data becomes probable, while rare true events get discounted.

Drawing on physics and philosophy, the paper treats a fact as real if it survives a change of viewpoint. The model answers from several viewpoints, such as 3 medical specialists, keeps what every answer shares, and abstains if nothing is shared.

The paper runs no experiments, so its proof is worked examples. On a single binary example, a loss of 0.67 means 100% accuracy, while a nearly equal loss of 0.71 means 0%.

Before trusting a confident answer, check whether it survives changes in persona, framing, or language.

推文來源 · X (Twitter)在 X 參與討論

讀者討論

理性交流 · 即時討論