模型放在本機跑時,記憶體預算和回答品質常要一起考量。
- Unsloth 為開放權重的 Qwen3.8-27B GGUF 推出 Dynamic V3.1 預覽版,並表示多數測試基準的成績提升了 5–10%。測試涵蓋程式開發、AI 助理和聊天。
- 多數 2-bit 到 6-bit 量化版本都可選,4-bit 版本約需 16–19GB VRAM,或配備 24GB 記憶體的 Mac,實際需求會隨上下文長度和解除安裝方式改變。3-bit 檔案仍保留 UD3,因為這次更新的改善不足以取代它。作者也檢查嵌入向量大小的計算、上下文預算和重複測試,提醒比較成績時要看清楚測試條件。
AI 伴隨問答
針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:
Unsloth reports 5-10% gains across most tested benchmarks with Dynamic V3.1 (preview), its latest quantization update for the open-weight Qwen3.8-27B GGUFs. 📜 Apache-2.0 License.
🤖 https://t.co/G0NsUd7rh8
🧪 Evaluated on practical workloads: coding, agents and chat, with benchmarks including Terminal Bench and DeepSWE.
🎛️ Pick your memory budget: most quantizations from 2-bit to 6-bit are available. The 3-bit files retain UD3 because V3.1 did not deliver enough improvement to justify replacing them.
💻 Run locally: the 4-bit version targets roughly 16-19GB VRAM, or a Mac with 24GB memory. Actual requirements depend on context length and offloading.
🛠️ Choose your stack: run through Unsloth Desktop, serve via unsloth run, or use llama.cpp.
📊 Benchmark details matter: Unsloth's analysis examines embedding-size accounting, context budgets and repeated runs, rather than relying on a single score.