跳到正文
𝕏 Rohan Paul(x.com)·· 4 小時前品質評分54
重點導讀

MIT 研究證明,GPT‑6 Astra 只需改動 0.016% 權重,即可將 Qwen3.5‑0.8B 在 MATH‑500 的解題準確率從 7.9% 提升至 48.1%。

AI 伴隨問答

自備 Key 深度分析

針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:

Rohan Paul
Rohan Paul@rohanpaul_ai
·4 小時前
𝕏

MASSIVE. MIT researchers showed that GPT-6 Astra can improve another AI model by changing its weights directly, without training.

Here, GPT-6 Astra raised Qwen3.5-0.8B from 7.9% to 48.1% on MATH-500 by editing 0.016% of its weights, without training.

Astra got Qwen’s weights in a Python notebook, plus a budget of 50 test runs on practice math problems. It saw the model kept repeating itself until it hit its length limit, traced that habit to a single internal signal written by 2 of its layers, and subtracted that signal out of the weights.

With the loop gone, the model could finish answers it was already capable of solving.

That single targeted edit changed 0.016% of the weights and lifted math accuracy from 7.9% to 48.1%.

推文來源 · X (Twitter)在 X 參與討論

讀者討論

理性交流 · 即時討論