跳到正文
𝕏 Together AI(x.com)·· 6 天前品質評分41
重點導讀

兩週前,我們宣佈推出 Together Compiler:可依據你的模型、晶片和流量調校推論的 AI 助理,吞吐量最高可提升 2.6 倍。

今天,我們分享背後的開發歷程:挑戰我們對 megakernels 假設的實驗、Torch Compile 出乎意料的優勢,以及促成我們開發新一代推論最佳化系統的經驗。

感謝 @dylan__lim @reyna_abhyankar @simran_s_arora 和團隊!

閱讀更多:https://t.co/9Yb1toI5jq

AI 伴隨問答

自備 Key 深度分析

針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:

Together AI
Together AI@togethercompute
·6 天前
𝕏

Two weeks ago we announced Together Compiler: agents that tune inference to your model, chip, and traffic, for up to 2.6x more throughput.

Today, we’re sharing the journey behind it: the experiments that challenged our assumptions of megakernels, the surprising strengths of Torch Compile, and the lessons that shaped our development of a next-generation system for inference optimization.

Shout out to @dylan__lim @reyna_abhyankar @simran_s_arora and the team!

Read more: https://t.co/9Yb1toI5jq

推文來源 · X (Twitter)在 X 參與討論

讀者討論

理性交流 · 即時討論