Fig. 1 Memory mapTop view, not to scale
GH1006 x HBM3e141GB total4.8 TB/s peak bandwidth
Hopper, PCIe dual-slotHover to light the stacks
Datacenter, Hopper
141 GB

H200 NVL 141GB

141 GB of HBM3e on a PCIe card. Drops into a 4U chassis, bridges to 4-way NVLink. The practical path to 564 GB per box.

$31,000

141 GB VRAM $220/GB VRAM

In stock. Lead time 72 hours.

Manufacturer warranty, DHL Express insured

Volume pricing

UnitsDiscountUnit price
1 unitList$31,000
2 to 7 units3% off$30,070
8 to 31 units6% off$29,140
32+ units10% off$27,900

Unit price at 1: $31,000

Request a bulk quote

Specifications

The full sheet.

Figures from the manufacturer datasheet. Price is an indicative street price, shown as from.

VRAM
141 GB
Memory
HBM3e
Bandwidth
4.8 TB/s
FP8
3.34 PFLOPS
FP4
Not supported
Board power
600 W
Form factor
PCIe dual-slot
NVLink
Yes
Architecture
Hopper
GPUs
1
Per GB of VRAM
$219.86
Availability
In stock, ships 72h
Sale
Buy online
SKU
H200-NVL
Overview

What it is for.

Workloads, sizing and what ships in the box.

141 GB of HBM3e in a PCIe slot.

The H200 memory on a dual-slot PCIe card at 600 W. It fits a 4U air-cooled chassis and bridges to 4-way NVLink, so four cards give 564 GB in one NVLink group. 4.8 TB/s per card, 3.34 PFLOPS FP8. In stock, ships in 72 hours. $31,000, about $220 per GB. NVLink bridges are sold separately.

Good for

  • Llama 3.1 70B at FP8 (84 GB with headroom) on one card.
  • Llama 3.1 405B at FP8 (486 GB) on four bridged cards.
  • Qwen2.5 72B at FP16 (173 GB) on two cards.

Fit rule: FP16 weights take 2 bytes per parameter, FP8 1 byte, 4-bit 0.5 bytes, plus 20% headroom for KV cache at short context.

Pairs with

NVLink bridges sold separately, 2-way and 4-way.

What fits

How much VRAM per box.

Card count is capped by slots and by the chassis power budget.

2U 4x PCIe
4 x 141 GB, 2,400 W of 3,200 W
Configure this box
Power75% of budget
564 GBper box
4U 8x PCIe
8 x 141 GB, 4,800 W of 6,400 W
Configure this box
Power75% of budget
1,128 GBper box
Pairs with

Parts bought alongside.

Same workload, a different trade between VRAM, bandwidth and price.