跳到正文
ollama release(github.com)· dhiltgen·· 2 天前品質評分44

Ollama v0.40.17-rc4 更新:Apple silicon 可同時處理多個請求

v0.40.17-rc4

重點導讀

Ollama 這次更新加入 Inkling 2 Mini,這款來自 Thinking Machines 的模型有 26B 引數、其中 5.4B 會啟用,能處理文字、圖片和工具呼叫,也能在 Mac 上執行。

  • 更新也讓 Apple silicon 上的 Ollama 可以同時處理多個請求。
  • 例如使用 Claude Code 時,MCP 工具會等到需要時才載入,不必一開始全部載入。除此之外,這版也修正多項模型載入和操作問題,並改善幾個啟動方式的設定處理。

AI 伴隨問答

自備 Key 深度分析

針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:

正文

Inkling 2 Mini

Inkling 2 Mini from Thinking Machines is a 26B parameter model with 5.4B active.

Its looped layers give it more computation per token than its size suggests, and it still fits on a Mac at about 20GB. It handles text and images, tool calls, and thinking, and scores 79.2% on SWE-Bench Verified).

  ollama run inkling-2-mini

What's Changed

  • ollama launch claude supports Claude Code's deferred tool loading, so MCP tools are loaded when needed instead of all at
    once

  • Ollama on Apple silicon now serves multiple requests at once.

  • ollama launch opencode sets thinking options from the model's metadata

  • ollama launch pi refreshes Pi's model list after sign-in and passes along prompt arguments

  • ollama launch chatgpt --restore asks before switching an active profile and preserves existing settings and chat history;
    quitting ChatGPT yourself now lets it exit through its own quit prompt

  • Running ollama with no arguments in a non-interactive shell prints help instead of erroring

  • Ctrl+C or Ctrl+G while in a multiline """ block leaves multiline mode instead of swallowing the next line

  • Changing the context shift setting no longer reloads the model

  • Vulkan now uses mmap for integrated GPUs, fixing Failed to allocate pinned memory load failures on shared-memory GPUs

  • On Windows iGPUs, partially offloaded models no longer fail to allocate the KV cache

  • Tool definitions passed through the API keep JSON schema keywords Ollama doesn't model instead of dropping them

  • Disabling thinking now maps to the model's lowest supported reasoning level rather than being ignored

  • Source builds can use prebuilt MLX-C and XGrammar binaries

    Full Changelog: v0.40.16...v0.40.17-rc3

來源: ollama release (github.com)
開啟原文

讀者討論

理性交流 · 即時討論