L40S 48GB
The universal datacenter card. 48 GB, FP8, video encode, runs in any 2U with 350 W to spare.
In stock. Lead time 72 hours.
Volume pricing
| Units | Discount | Unit price |
|---|---|---|
| 1 unit | List | $8,900 |
| 2 to 7 units | 3% off | $8,633 |
| 8 to 31 units | 6% off | $8,366 |
| 32+ units | 10% off | $8,010 |
Unit price at 1: $8,900
Request a bulk quote
The full sheet.
Figures from the manufacturer datasheet. Price is an indicative street price, shown as from.
- VRAM
- 48 GB
- Memory
- GDDR6
- Bandwidth
- 864 GB/s
- FP8
- 1.466 PFLOPS
- FP4
- Not supported
- Board power
- 350 W
- Form factor
- PCIe dual-slot
- NVLink
- No
- Architecture
- Ada Lovelace
- GPUs
- 1
- Per GB of VRAM
- $185.42
- Availability
- In stock, ships 72h
- Sale
- Buy online
- SKU
- L40S
What it is for.
Workloads, sizing and what ships in the box.
48 GB, FP8 and video encode in any 2U.
The general-purpose datacenter card. 48 GB of GDDR6, 1.466 PFLOPS of FP8, hardware video encode and decode, 350 W. It fits a standard 2U with dual-slot clearance and needs no NVLink planning. In stock, ships in 72 hours. $8,900, about $185 per GB of VRAM. Bulk tiers start at 2 units: 3% off, then 6% at 8 and 10% at 32.
Good for
- Llama 3.1 8B at FP16 (19 GB with headroom) at high batch.
- Mistral Small 24B at FP8 (29 GB) on one card.
- Llama 3.1 70B at 4-bit (42 GB) on one card, short context.
Fit rule: FP16 weights take 2 bytes per parameter, FP8 1 byte, 4-bit 0.5 bytes, plus 20% headroom for KV cache at short context.
Pairs with
- RTX PRO 6000 Blackwell Server Edition 96GB, double the memory per slot.
- H100 NVL 94GB, for the larger models in the same fleet.
How much VRAM per box.
Card count is capped by slots and by the chassis power budget.
Parts bought alongside.
Same workload, a different trade between VRAM, bandwidth and price.