跳到正文
𝕏 Thomas Wolf(x.com)·· 2 天前品質評分59
重點導讀

一般 CDN 擅長把許多小檔案送給各地使用者,但下載 AI 模型時,常是少數大型檔案被大量機器抓取,舊的做法就不太合用。

  • Hugging Face 表示,他們從今年夏天起自建 CDN,每月傳送近 1 exabyte,實際流量約為每秒 420 GB、每秒 80,000 次請求。
  • 新的快取設計是為大型檔案、發布日流量暴增,以及多個熱門模型和大型資料集同時下載而打造,團隊也做了即時流量地圖。

AI 伴隨問答

自備 Key 深度分析

針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:

Thomas Wolf
Thomas Wolf@Thom_Wolf
·2 天前
𝕏

AI downloads broke the usual CDN model

Since this summer, we're running our own CDN at Hugging Face. It's shipping almost 1 exabyte per month, which means, in practice, about 420 GB every second, through 80,000 requests per second.

Why did we need to build our own?

Well, CDNs were designed to ship many small web files to many people. AI downloads are pretty different: it's a few enormous files, a significant part of them pulled by machines.

This changes a lot of design assumptions.

You're not caching small objects close to users in hundreds of cities anymore: these users are for a big part GPU clusters sitting in a handful of cloud regions.

And a cached web page is useful to 1,000 visitors, while a cached 1,000 GB model is useful to far fewer clients, but each one wants all of it, immediately.

So we've built our own CDN, with caches adapted to massive objects, able to handle release-day mega-floods and multiple giant datasets and trending models being pulled at once.

The team made a live map of it at https://t.co/hx0ZISQWDo

Hard to stop watching it - it's quite mesmerizing

推文來源 · X (Twitter)在 X 參與討論

讀者討論

理性交流 · 即時討論