跳到正文
𝕏 Artificial Analysis(x.com)·· 12 天前精選品質評分66
重點導讀

Keenable Search 1.0 的 pro 與 realtime 模式在 Artificial Analysis Search Index 分別獲得 83 分與 82 分,高於 Exa 與 Perplexity 的 80 分。

AI 伴隨問答

自備 Key 深度分析

針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:

推薦理由

這組基準同時呈現搜尋品質、任務成本與速度,並交代測試設定,方便比較不同搜尋工具在代理任務中的表現。

Artificial Analysis
Artificial Analysis@ArtificialAnlys
·12 天前
𝕏

Keenable Search 1.0 takes 1st (pro, 83) and 2nd (realtime, 82) on the Artificial Analysis Search Index: ahead of Exa (auto, dynamic highlights) and Perplexity (medium) at 80

We benchmarked both modes of @KeenableAI's Keenable Search 1.0, pro and realtime, in our Stirrup agent harness with Keenable Search as its web_search tool to complete 1700 search-focused tasks.

At $4 per 1k searches, Keenable costs about $0.040 per task in both modes, over a third below the board median ($0.063). It is also one of the fastest products we measure: 15.0s (realtime) and 15.5s (pro) per task, 2nd and 3rd on the board.

Key benchmarking results for Keenable Search 1.0:

➤ Artificial Analysis Search Index: Keenable (pro) scores 83 and Keenable (realtime) 82, up from 67 for both modes when we first benchmarked Keenable in August, and a ~50-point lift over the same model with no search (33). Both lead Exa (auto, dynamic highlights) and Perplexity (medium) at 80

➤ DeepSearchQA is Keenable's strongest benchmark: both modes score 88 F1, 1st and 2nd of 26, ahead of Exa (auto, dynamic highlights) at 86. Pro also ranks 1st on BrowseComp (87%, level with Perplexity (medium)) and on AA-Omniscience (73%, level with Exa (auto, dynamic highlights) and Firecrawl)

➤ Fast search: realtime takes 2.3s of search time per task (2nd of 26) and pro 3.0s (3rd), against a board median of 12.5s. Each search returns in about 330ms (realtime) and 390ms (pro) on average

Key details:

➤ Setup: GPT-5.6 Luna (medium) in Stirrup, Keenable Search API with mode=realtime and mode=pro

➤ Pricing: $4 per 1k requests in both modes (public pay-as-you-go price)

➤ Cards: We disabled Keenable's search cards for testing (disable_cards=true)

推文來源 · X (Twitter)在 X 參與討論

讀者討論

理性交流 · 即時討論