重點導讀
每次呼叫 LLM 前,都要先決定該用哪個模型,選得快又合適能省下時間和費用。
- NaceAI 推出 Drex Router,會讀取提示詞和可選模型清單,再用 Gemma 為基礎的 12B 模型挑選模型,約需 57 到 87 毫秒。NaceAI 以 1,400 道一般知識考題測試,Drex Router 得分為 87.6%,每 1,000 題費用是 $0.10。
- Jev Router 得分為 86.4%,費用是 $1.09。Drex Router 也會提供各候選模型的機率和簡短理由,讓人看出選擇有多大把握。
AI 伴隨問答
針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:
Rohan Paul@rohanpaul_ai
·2 天前
A model decision in under 90 ms is fast enough to put a router in front of almost any LLM call.
@NaceAI just launched Drex Router, and it reads the prompt and your list of models, then returns its pick in about 57 to 87 ms, using a 12B model built on Gemma.
In Nace’s tests on 1,400 general-knowledge exam questions, it scored 87.6% for $0.10 per 1,000 questions, while rival Jev Router scored 86.4% for $1.09.
A router that only returns a model name can’t tell you a confident pick from a coin flip. Drex Router returns a probability for every candidate plus a short reason,
推文來源 · X (Twitter)在 X 參與討論
來源: Rohan Paul (x.com)
在 X 查看推文