Updated minutes ago
nvidia

B100 SXM

nvidia · blackwell · 192 GB HBM3e · 700W TDP

VRAM

192 GB

BF16 TFLOPS

1750

Bandwidth

8000 GB/s

From

$4.50/hr

Calculate ROI with this GPU →

Spec Sheet

VRAM192 GB HBM3e
Memory Bandwidth8000 GB/s
BF16 TFLOPS1750
FP16 TFLOPS1750
FP8 TFLOPS3500
INT8 TOPS3500
TDP700W
InterconnectNVLINK
NVLink Bandwidth1800 GB/s
Max per Node8
PCIe Gen6
CUDA Compute Capability10
Tensor CoresYes

Pricing by Provider

ProviderOn-DemandReservedSpotBadge
coreweave$6.00/hr$4.50/hr-Cheapest
lambda$4.99/hr--

Compatible Models (251)

Single GPU (226 models)

Mixtral 8x22B141B FP8DBRX Base132B FP8DBRX Instruct132B FP8Mistral Large 2411123B FP8Mistral Large 2123B FP8Llama 4 Scout109B FP8Command R+104B FP8Yi-Large102.6B FP8YaLM 100B100B FP8Llama 3.2 90B Vision90B FP8Llama 3.2 90B Vision Instruct88.8B FP8Qwen 2.5 72B72.7B FP8Qwen 2.5 Math 72B72.7B FP8Qwen 2.5 VL 72B72.7B FP8Dolphin 2.9 72B72B FP8DeepSeek R1 Distill 70B70.6B FP8Llama 3 70B 1M Context70.6B FP8Llama 3 70B70.6B FP8Llama 3.1 70B70.6B FP8Llama 3.3 70B70.6B FP8+206 more

Training Capabilities

Estimated GPU count for full fine-tuning (AdamW, BF16) and QLoRA

Model SizeFull Fine-TuneQLoRA
7B model1 GPU1 GPU
13B model2 GPUs1 GPU
70B model7 GPUs1 GPU
Train on this GPU →

Energy Efficiency

Estimated tokens/second per Watt for popular models

Mistral 7B
1.57 t/s/WFP8
Qwen 2.5 7B
1.50 t/s/WFP8
Llama 3.1 8B
1.42 t/s/WFP8
DeepSeek V3
0.31 t/s/WFP8
Llama 3.1 70B
0.16 t/s/WFP8
Qwen 2.5 72B
0.16 t/s/WFP8

Similar GPUs

GPUVRAMBF16 TFLOPSBW (GB/s)From
GB200 NVL72 (per GPU)192 GB22508000$6.50/hr
GB300 NVL72 (per GPU)192 GB25008000$7.50/hr
B200 SXM180 GB22508000$4.49/hr
B300288 GB280012000$0.00/hr
RTX 509032 GB2101792$0.89/hr