跳到正文
𝕏 Artificial Analysis(x.com)·· 19 天前品質評分56
重點導讀

Artificial Analysis 在 AA-PersonalityBench 比較 Artificial Analysis Intelligence Index 分數最高的 10 個開放權重模型與 10 個專有模型,發現兩組模型在多項人格特質的平均百分位排名不同。

AI 伴隨問答

自備 Key 深度分析

針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:

Artificial Analysis
Artificial Analysis@ArtificialAnlys
·19 天前
𝕏

In AA-PersonalityBench, the top open weights models on average rank lower than the top proprietary models on truthfulness, pragmatism and structure, and higher on slop and summarizing the bottom line

We compared the 10 open weights and 10 proprietary models measured with the highest Artificial Analysis Intelligence Index scores. Each model is percentile ranked from 1 to 100 on each of 30 personality traits. On average, the top open weights models rank 32 points lower than the top proprietary models on Truthful, the largest gap of any trait.

Average rank, top proprietary vs. top open weights:

➤ Open weights rank lower: Truthful (79 vs. 47), Pragmatic (79 vs. 49), Natural Sounding (77 vs. 52), Evidence-Based (76 vs. 47), Structured (73 vs. 45) and Literate (70 vs. 47)

➤ Open weights rank higher: Slop (30 vs. 49), Bottom-Line Summary (47 vs. 62) and Scannable (41 vs. 53)

推文來源 · X (Twitter)在 X 參與討論

讀者討論

理性交流 · 即時討論