跳到正文
𝕏 Rohan Paul(x.com)·· 4 小時前品質評分51
重點導讀

ClaimNov 是一種將研究提案拆分為多個宣告並逐一比對先前文獻的工具,能顯著降低 AI 新穎性檢查對後來發表研究的誤拒率。

  • - 誤拒率:傳統檢查在 380 個偽造複製案中全部被捕捉,但對 96% 後續被發表的創意也被拒絕。
  • ClaimNov 只拒絕 1.5%。
Rohan Paul
Rohan Paul@rohanpaul_ai
·4 小時前
𝕏

New University of Illinois paper finds that when AI decides if a research idea is new enough to work on, it often says no to ideas that human scientists later publish.

AI scientist pipelines run a novelty check to decide which generated ideas get compute. These checks judge a whole proposal at once, though most real papers build on some earlier contributions.

They built ClaimNov, which splits a proposal into a few claims, matches each against claims from prior papers, and gives a judge the claim-by-claim evidence.

A deployed check caught all 380 disguised copies but also rejected 96% of ideas researchers later published. ClaimNov caught 97% of copies while rejecting only 1.5% of those ideas.

If your pipeline filters ideas for novelty, score claims separately and keep proposals that build on 1 known result instead of discarding them.

推文來源 · X (Twitter)在 X 參與討論