重點導讀
summary_zh: Together Compiler 透過自動化代理持續最佳化模型、硬體與流量的 kernel,將 FlashAttention、ThunderKittens、ThunderAgent 等前沿研究擴充套件到每一個客戶部署。
AI 伴隨問答
針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:
Together AI@togethercompute
·16 天前
Introducing Together Compiler: agents that continually optimize kernels for your model, your hardware, and your traffic.
We built this to scale frontier research from the teams behind FlashAttention, ThunderKittens, ThunderAgent, and more to every customer deployment.
So far we're seeing:
👉 +12% to +20% median TPS on serverless endpoints our researchers had already heavily optimized by hand
👉 Customers in production cutting response and generation times by about a third to nearly half
Read the full story: https://t.co/wnRX2rWDnx
推文來源 · X (Twitter)在 X 參與討論
來源: Together AI (x.com)
在 X 查看推文