跳到正文
𝕏 Rohan Paul(x.com)·· 18 天前品質評分61
重點導讀

導語:NVIDIA 研究指出,AI 代理透過頻繁壓縮歷史記錄,能在保持短上下文的同時僅略微降低準確率,且可大幅降低生成成本。

  • - 成本效益:在 256K 上下文視窗下,生成每個 token 的成本比 16K 視窗高 3.6 倍至 7 倍。
  • 透過壓縮可避免此成本上升。

AI 伴隨問答

自備 Key 深度分析

針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:

Rohan Paul
Rohan Paul@rohanpaul_ai
·18 天前
𝕏

New NVIDIA paper finds that AI agents barely lose accuracy when they keep contexts short by compacting their history often.

Each new token costs more to generate as the context grows. Serving open models at a 256K context window instead of 16K cost 3.6x to 7x more per generated token.

They had agents stop at a set limit, write a short handoff note, and restart with only the task and that note. For long documents, the agent searched files with Bash tools instead of reading everything at once.

On 6 long-horizon benchmarks, at most 5 of 22 compaction settings per model lost more than 2 points versus full history. Compacting after every action kept Claude Opus 4.5 at 70.2% on SWE-bench Verified, versus 70.0% with full history.

Before paying for long context, give agents a structured handoff note and file search tools, then check if short contexts match your accuracy.

推文來源 · X (Twitter)在 X 參與討論

讀者討論

理性交流 · 即時討論