Ollama v0.40.17-rc4 更新:Apple silicon 可同時處理多個請求
v0.40.17-rc4
Ollama 這次更新加入 Inkling 2 Mini,這款來自 Thinking Machines 的模型有 26B 引數、其中 5.4B 會啟用,能處理文字、圖片和工具呼叫,也能在 Mac 上執行。
- 更新也讓 Apple silicon 上的 Ollama 可以同時處理多個請求。
- 例如使用 Claude Code 時,MCP 工具會等到需要時才載入,不必一開始全部載入。除此之外,這版也修正多項模型載入和操作問題,並改善幾個啟動方式的設定處理。
AI 伴隨問答
針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:
Inkling 2 Mini
Inkling 2 Mini from Thinking Machines is a 26B parameter model with 5.4B active.
Its looped layers give it more computation per token than its size suggests, and it still fits on a Mac at about 20GB. It handles text and images, tool calls, and thinking, and scores 79.2% on SWE-Bench Verified).
ollama run inkling-2-mini
What's Changed
-
ollama launch claudesupports Claude Code's deferred tool loading, so MCP tools are loaded when needed instead of all at
once -
Ollama on Apple silicon now serves multiple requests at once.
-
ollama launch opencodesets thinking options from the model's metadata -
ollama launch pirefreshes Pi's model list after sign-in and passes along prompt arguments -
ollama launch chatgpt --restoreasks before switching an active profile and preserves existing settings and chat history;
quitting ChatGPT yourself now lets it exit through its own quit prompt -
Running
ollamawith no arguments in a non-interactive shell prints help instead of erroring -
Ctrl+C or Ctrl+G while in a multiline
"""block leaves multiline mode instead of swallowing the next line -
Changing the context shift setting no longer reloads the model
-
Vulkan now uses mmap for integrated GPUs, fixing
Failed to allocate pinned memoryload failures on shared-memory GPUs -
On Windows iGPUs, partially offloaded models no longer fail to allocate the KV cache
-
Tool definitions passed through the API keep JSON schema keywords Ollama doesn't model instead of dropping them
-
Disabling thinking now maps to the model's lowest supported reasoning level rather than being ignored
-
Source builds can use prebuilt MLX-C and XGrammar binaries
Full Changelog: v0.40.16...v0.40.17-rc3