跳到正文
Hacker News (official RSS)(heymaxwell.ai)·· 8 小時前精選AI 評分68

Maxwell:程式與硬體之間的新型模型

Maxwell: A new kind of model that sits between code and hardware

AI 導讀

Maxwell 是一款能在執行時即時重寫程式碼並進行形式驗證的模型,能在 CPU 與 GPU 上將資料處理與 AI 推理速度提升數倍。

  • 效能提升:資料處理管線加速 38 倍,AI 推理核加速 4.25 倍,4K 影片生成速度提升 1.87 倍。
推薦理由

Maxwell 透過即時程式重寫與形式驗證,將 AI 推理與資料處理速度提升數倍,讀者可參考其自動化最佳化方法以提升工作流程效能。

正文 · 原文

by doubleAI

Maxwell understands and improves code while it runs, reasoning about hardware and data, not just code. Every improvement is formally proven equivalent to the original code. Read the manifesto 

  • 38×faster data processing pipelines
  • 4.25×faster AI inference kernels

What is a code execution model?

A short animated film, with narration and captions, introducing Maxwell: most code never sees the hardware it runs on or the data it processes. Maxwell watches a program while it runs, rewrites the binary underneath to fit that exact machine and data, and formally proves every improvement equivalent to the original. It runs on CPUs and GPUs, speeding up data pipelines and AI inference kernels.

Featured customer

LTX-2.5 generates 4K video in half the time

LTX built LTX-2.5 for efficiency from day one, compiled end to end, sequence-parallel across GPUs, decoding on a hand-written attention kernel. A pipeline built and optimized by top human experts. Maxwell made their 4K generation nearly twice as fast.

(opens ltx.io)

  • 1.87×faster 4K video generation
  • 134sper 4K clip on two B200s, down from 250s

Read the story 

Maxwell’s Demonstration

See Maxwell in action optimizing both GPU-based and CPU-based code. Once Maxwell has enough runtime data, it swaps in formally proven optimizations tailored to that exact machine while the program keeps running.

GPU-based speech-to-text using Whisper

Two terminals run the same Python script on the same RTX 4090: 180 transcriptions with Whisper-small from a cold start. Without Maxwell, on the left, it takes 106.23 seconds. With Maxwell, on the right, it completes in 49.82 seconds. Both produce identical transcripts. The recording plays at 4× speed.

CPU-based graph algorithms

Two terminals run the same Python script on the same machine: NetworkX betweenness centrality, 15 runs. Without Maxwell, on the left, it takes 61.44 seconds. With Maxwell, on the right, it completes in 17.50 seconds. Both print identical results. The recording plays at 4× speed.

Research behind Maxwell

  1. Maxwell approaches Speed of Light on Blackwell

    After one day of search, Maxwell beats NVIDIA’s PyTorch baselines on 90% of SOL-ExecBench’s Blackwell kernels.

    (opens on doubleai.com)
  2. doubleAI’s Maxwell: Surpassing Expert-Written Kernels At Scale

    Independently generated and verified a hyper-optimized drop-in version of NVIDIA cuGraph, 3.6× faster on average.

    (opens on doubleai.com)
  3. Blazing Fast pandas Without Changing a Line

    Maxwell completely rewrote pandas’ kernels from scratch, specialized for modern hardware.

    (opens on doubleai.com)
來源: Hacker News (official RSS) (heymaxwell.ai)
開啟原文