重點導讀
導語：Meta 在俄亥俄州新奧爾卑裡部署 Prometheus 超級叢集，訓練 Muse 基礎模型，包括 Muse Wonder。
- 超級叢集規模：數十萬 GPU，Gigawatt 等級。
推薦理由
此公告說明瞭 Prometheus 超級叢集的高效能與容錯設計，對於大規模模型訓練的資源最佳化具有參考價值。
AI at Meta@AIatMeta
·11 天前
We trained our Muse foundational models, including Muse Wonder, at Prometheus, our gigawatt-scale supercluster in New Albany, Ohio.
Across a supercluster with hundreds of thousands of GPUs, even one underperforming host can slow an entire training run. We engineered Prometheus for resilience at scale, achieving 85%+ goodput on pretraining, 90%+ on reinforcement learning and ~47K GPU hours mean time between interruptions during Muse Wonder training.
Take a look at the tech powering Prometheus: https://t.co/WSFODnGRST
推文來源 · X (Twitter)在 X 參與討論
來源： AI at Meta (x.com)
在 X 查看推文