跳到正文
𝕏 Rohan Paul(x.com)·· 2 天前品質評分62
重點導讀

每次呼叫 LLM 前,都要先決定該用哪個模型,選得快又合適能省下時間和費用。

  • NaceAI 推出 Drex Router,會讀取提示詞和可選模型清單,再用 Gemma 為基礎的 12B 模型挑選模型,約需 57 到 87 毫秒。NaceAI 以 1,400 道一般知識考題測試,Drex Router 得分為 87.6%,每 1,000 題費用是 $0.10。
  • Jev Router 得分為 86.4%,費用是 $1.09。Drex Router 也會提供各候選模型的機率和簡短理由,讓人看出選擇有多大把握。

AI 伴隨問答

自備 Key 深度分析

針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:

Rohan Paul
Rohan Paul@rohanpaul_ai
·2 天前
𝕏

A model decision in under 90 ms is fast enough to put a router in front of almost any LLM call.

@NaceAI just launched Drex Router, and it reads the prompt and your list of models, then returns its pick in about 57 to 87 ms, using a 12B model built on Gemma.

In Nace’s tests on 1,400 general-knowledge exam questions, it scored 87.6% for $0.10 per 1,000 questions, while rival Jev Router scored 86.4% for $1.09.

A router that only returns a model name can’t tell you a confident pick from a coin flip. Drex Router returns a probability for every candidate plus a short reason,

推文來源 · X (Twitter)在 X 參與討論

讀者討論

理性交流 · 即時討論