Updated minutes ago
nvidia

GB300 NVL72 (per GPU)

nvidia · blackwell · 192 GB HBM3e · 1200W TDP

VRAM

192 GB

BF16 TFLOPS

2500

Bandwidth

8000 GB/s

From

$7.50/hr

Calculate ROI with this GPU →

Spec Sheet

VRAM192 GB HBM3e
Memory Bandwidth8000 GB/s
BF16 TFLOPS2500
FP16 TFLOPS2500
FP8 TFLOPS5000
INT8 TOPS5000
TDP1200W
InterconnectNVSWITCH
NVLink Bandwidth1800 GB/s
Max per Node72
PCIe Gen6
CUDA Compute Capability10
Tensor CoresYes

Pricing by Provider

ProviderOn-DemandReservedSpotBadge
coreweave$9.50/hr$7.50/hr-Cheapest

Compatible Models (253)

Single GPU (226 models)

Mixtral 8x22B141B FP8DBRX Base132B FP8DBRX Instruct132B FP8Mistral Large 2411123B FP8Mistral Large 2123B FP8Llama 4 Scout109B FP8Command R+104B FP8Yi-Large102.6B FP8YaLM 100B100B FP8Llama 3.2 90B Vision90B FP8Llama 3.2 90B Vision Instruct88.8B FP8Qwen 2.5 72B72.7B FP8Qwen 2.5 Math 72B72.7B FP8Qwen 2.5 VL 72B72.7B FP8Dolphin 2.9 72B72B FP8DeepSeek R1 Distill 70B70.6B FP8Llama 3 70B 1M Context70.6B FP8Llama 3 70B70.6B FP8Llama 3.1 70B70.6B FP8Llama 3.3 70B70.6B FP8+206 more

Training Capabilities

Estimated GPU count for full fine-tuning (AdamW, BF16) and QLoRA

Model SizeFull Fine-TuneQLoRA
7B model1 GPU1 GPU
13B model2 GPUs1 GPU
70B model7 GPUs1 GPU
Train on this GPU →

Energy Efficiency

Estimated tokens/second per Watt for popular models

Mistral 7B
0.91 t/s/WFP8
Qwen 2.5 7B
0.88 t/s/WFP8
Llama 3.1 8B
0.83 t/s/WFP8
DeepSeek V3
0.18 t/s/WFP8
Llama 3.1 70B
0.09 t/s/WFP8
Qwen 2.5 72B
0.09 t/s/WFP8

Similar GPUs

GPUVRAMBF16 TFLOPSBW (GB/s)From
B100 SXM192 GB17508000$4.50/hr
GB200 NVL72 (per GPU)192 GB22508000$6.50/hr
B200 SXM180 GB22508000$4.49/hr
B300288 GB280012000$0.00/hr
RTX 509032 GB2101792$0.89/hr