Updated minutes ago
B200 NVL (pair)
nvidia · blackwell · 360 GB HBM3e · 1800W TDP
VRAM
360 GB
BF16 TFLOPS
4500
Bandwidth
16000 GB/s
From
$10.50/hr
Spec Sheet
VRAM360 GB HBM3e
Memory Bandwidth16000 GB/s
BF16 TFLOPS4500
FP16 TFLOPS4500
FP8 TFLOPS9000
INT8 TOPS9000
TDP1800W
InterconnectNVLINK
NVLink Bandwidth1800 GB/s
Max per Node4
PCIe Gen6
CUDA Compute Capability10
Tensor CoresYes
Pricing by Provider
| Provider | On-Demand | Reserved | Spot | Badge |
|---|---|---|---|---|
| coreweave | $14.00/hr | $10.50/hr | - | Cheapest |
| lambda | $11.49/hr | - | - |
Compatible Models (251)
Single GPU (232 models)
DeepSeek Coder V2 236B236B FP8DeepSeek V2.5236B FP8Qwen 3 235B235B FP8Falcon 180B180B FP8Mixtral 8x22B141B FP8DBRX Base132B FP8DBRX Instruct132B FP8Mistral Large 2411123B FP8Mistral Large 2123B FP8Command A111B BF16Llama 4 Scout109B FP8Command R+104B FP8Yi-Large102.6B FP8Inflection 3100B BF16YaLM 100B100B FP8Llama 3.2 90B Vision90B FP8Llama 3.2 90B Vision Instruct88.8B FP8Qwen 2.5 72B72.7B FP8Qwen 2.5 Math 72B72.7B FP8Qwen 2.5 VL 72B72.7B FP8+212 more
Multi-GPU (19 models)
Megatron-Turing NLG 530Bx2 FP8Snowflake Arctic 480Bx2 FP8Llama 3.1 405Bx2 FP8Llama 4 Maverickx2 FP8Jamba 1.5 Largex2 FP8Snowflake Arctic 128x3Bx2 FP8Nemotron 340Bx2 FP8Grok-2x2 FP8Claude Opus 4x2 BF16GPT-4ox2 BF16GPT-4 Turbox2 BF16o1x2 BF16Gemini 1.5 Prox2 BF16Claude 3 Opusx2 BF16DeepSeek R1x3 FP8+4 more
Training Capabilities
Estimated GPU count for full fine-tuning (AdamW, BF16) and QLoRA
| Model Size | Full Fine-Tune | QLoRA |
|---|---|---|
| 7B model | 1 GPU | 1 GPU |
| 13B model | 1 GPU | 1 GPU |
| 70B model | 4 GPUs | 1 GPU |
Energy Efficiency
Estimated tokens/second per Watt for popular models
Mistral 7B
1.22 t/s/WFP8
Qwen 2.5 7B
1.17 t/s/WFP8
Llama 3.1 8B
1.11 t/s/WFP8
DeepSeek V3
0.24 t/s/WFP8
Llama 3.1 70B
0.13 t/s/WFP8
Qwen 2.5 72B
0.12 t/s/WFP8
Similar GPUs
| GPU | VRAM | BF16 TFLOPS | BW (GB/s) | From |
|---|---|---|---|---|
| B300 | 288 GB | 2800 | 12000 | $0.00/hr |
| B100 SXM | 192 GB | 1750 | 8000 | $4.50/hr |
| GB200 NVL72 (per GPU) | 192 GB | 2250 | 8000 | $6.50/hr |
| GB300 NVL72 (per GPU) | 192 GB | 2500 | 8000 | $7.50/hr |
| B200 SXM | 180 GB | 2250 | 8000 | $4.49/hr |