跳到正文
𝕏 Together AI(x.com)·· 16 天前品質評分45
重點導讀

summary_zh: Together Compiler 透過自動化代理持續最佳化模型、硬體與流量的 kernel,將 FlashAttention、ThunderKittens、ThunderAgent 等前沿研究擴充套件到每一個客戶部署。

AI 伴隨問答

自備 Key 深度分析

針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:

Together AI
Together AI@togethercompute
·16 天前
𝕏

Introducing Together Compiler: agents that continually optimize kernels for your model, your hardware, and your traffic.

We built this to scale frontier research from the teams behind FlashAttention, ThunderKittens, ThunderAgent, and more to every customer deployment.

So far we're seeing:
👉 +12% to +20% median TPS on serverless endpoints our researchers had already heavily optimized by hand

👉 Customers in production cutting response and generation times by about a third to nearly half

Read the full story: https://t.co/wnRX2rWDnx

推文來源 · X (Twitter)在 X 參與討論

讀者討論

理性交流 · 即時討論