Ollama v0.40.17-rc1 加入批次式推測驗證
v0.40.17
多個請求同時產生內容時,逐一檢查草稿可能拖慢速度。
- Ollama v0.40.17-rc1 的 mlxrunner 改成批次檢查,讓不同請求共用目標模型的驗證工作,同時保留各自的抽樣方式和快取回復。
- 它也會分別學習同時處理多個請求時該寫多長的草稿,並處理取消請求、不同生成方式混用等情況,讓並行生成時的草稿和檢查更能配合。
AI 伴隨問答
針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:
Release v0.40.17-rc1: mlxrunner: batch speculative verification (#19663) · ollama/ollama · GitHub
Navigation Menu
[](https://github.com/)
- Products
- Platform
- *

GitHub Repository hosting, code review, and collaboration - *

Copilot AI coding agent for tasks, projects, and automated work
- Build & Ship
- * Actions CI/CD and automation
- * Code Quality Quality analysis, fixes, and enforcement
- * Codespaces Cloud development environments
- Secure
- * Code Security Vulnerability detection and remediation
- * Secret Protection Secret scanning and leak prevention
- Developers
- Learn
- * Documentation
- * Training
- * Certifications
- Build
- * Build with Copilot
- * Customize Copilot
- * Integrations
- Explore
- * Trending repos
- * GitHub Sponsors
- * Developer articles
- Businesses
- By Stage
- * Enterprises
- * Team
- * Startups
- * Nonprofits
- By Industry
- * Healthcare
- * Financial services
- * Manufacturing
- * Government
- * See all industries
- Evaluate GitHub
- * Why GitHub
- * Customer Stories
- * Business insights
- * Trust Center
- Add-ons
- * GitHub Advanced Security Enterprise-grade code security
- * Copilot for business Enterprise-grade AI features
- * Premium Support Enterprise-grade 24/7 support
- Resources
- Learn & Connect
- * Documentation
- * Resource center
- * Blog
- * Events & webinars
- * Community Forum
- * Customer Stories
- * Integrations
- Support
- * Customer support
- * Training
- * GitHub Status
- GitHub Universe
- *

GitHub Universe The event for developers, by developers — talks, workshops, and what’s next for GitHub.
Search/
Appearance settings
You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
1. 1 more breadcrumb items
2. ollama
3. ollama
Repository navigation
More items
v0.40.17-rc1
- v0.40.17-rc1
db5266a- Verified# Verified
This commit was created on GitHub.com and signed with GitHub’s verified signature. GPG key ID: B5690EEEBB952194 Verified Learn about vigilant mode
* Compare# Choose a tag to compare ## Sorry, something went wrong. Filter Loading ## Sorry, something went wrong. ### Uh oh!
There was an error while loading. Please reload this page. ## No results found View all tags
v0.40.17-rc1: mlxrunner: batch speculative verification (#19663)
- v0.40.17-rc1
db5266a- Compare# Choose a tag to compare ## Sorry, something went wrong. Filter Loading ## Sorry, something went wrong. ### Uh oh!
There was an error while loading. Please reload this page. ## No results found View all tags
* Verified# Verified
This commit was created on GitHub.com and signed with GitHub’s verified signature. GPG key ID: B5690EEEBB952194 Verified Learn about vigilant mode
dhiltgen tagged this 16 Nov 16:43
- mlxrunner: batch speculative verification
Keep drafting active for concurrent generation by sharing target verification while preserving per-request sampling and cache rollback. Learn draft depth for each concurrent workload separately from isolated requests, and preserve probes that short requests never execute.
Materialize owned target features before a reader can pause, and cover acceptance, cancellation, handoffs, mixed decoding and retained-memory boundaries.
- address comments
Assets 2
- Source code (zip) 2026-11-16T16:43:54Z
- Source code (tar.gz) 2026-11-16T16:43:54Z
Footer
[](https://github.com/) © 2026 GitHub,Inc.
Footer navigation
You can’t perform that action at this time.

Changelog Your source for the latest features, improvements, and fixes across GitHub products, all in one place.