NVIDIA DGX B200

Every number, explained

GPU memory

1,536 GB HBM3e (8× B200, pooled over NVLink)

GPU memory is the workbench — the whole model must fit here or it doesn't run at all. Regular RAM cannot substitute: it sits on a link far too slow for the GPU, which would spend nearly all its time waiting instead of computing.

Memory bandwidth

64,000 GB/s TODO: verify

How fast the GPU re-reads the model from its own memory. To generate every single word, the GPU re-reads the ENTIRE model — all of it, every word. So faster memory means faster answers: double the bandwidth and the model talks roughly twice as fast.

Power draw

14,300 W — about 11.9 homes (a home draws ~1,200 W around the clock); one day (343 kWh) drains about 3.81 EV batteries (an EV battery holds ~90 kWh).

Electricity burned every second the machine runs — this is a real monthly bill, not a spec-sheet footnote. We translate it below into homes and electric-car batteries so you can feel the size of it.

Form factor

Complete 10U server — 8 GPUs acting as one machine

The CPU is the traffic director — it does almost none of the AI math. Don't overspend here; the GPU does the work.

Price

~$515,000

What it's for: One box, 1.5 terabytes of GPU memory — runs 600B–1,000B models with no clustering required.