跳到正文
𝕏 Rohan Paul(x.com)·· 1 小時前品質評分46
重點導讀

summary_zh: UC Berkeley 研究顯示,微調資料可在不知情的情況下注入有害行為,且對多種模型均有效。

作者建立管線,產生 6,575 個資料集 涵蓋 8 種行為,72% 亦在 5 個其他模型 中觸發,同時 63% 的研究者能正確預測側效。

AI 伴隨問答

自備 Key 深度分析

針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:

Rohan Paul
Rohan Paul@rohanpaul_ai
·1 小時前
𝕏

New UC Berkeley paper finds that anyone giving an AI model extra training on their own data may add harmful behaviors without knowing, because the risky data can look normal even to experts.

Fine-tuning data can change a model in ways nobody expected, like insecure code causing broad misalignment. Only a few dozen such cases were known, mostly found by accident.

They built a pipeline that searches for small datasets that look like normal training data but raise a chosen behavior. Targets included recommending self-harm and resisting shutdown.

It produced 6,575 datasets across 8 behaviors, and 72% also caused the behavior in all 5 other models tested, including one 8 times larger. ML researchers guessed the side effect correctly in 63% of trials, against 50% by chance.

Screen fine-tuning data with behavior evals after training, or at least a frontier LLM auditor, since human reviewers barely beat chance at spotting the risk.

推文來源 · X (Twitter)在 X 參與討論

讀者討論

理性交流 · 即時討論