Skip to content
Updated minutes ago
amd

Instinct MI210

amd · cdna2 · 64 GB HBM2e · 300W TDP

VRAM

64 GB

BF16 TFLOPS

181

Bandwidth

1638 GB/s

From

$0.99/hr

Calculate ROI with this GPU →

Spec Sheet

VRAM64 GB HBM2e
Memory Bandwidth1638 GB/s
BF16 TFLOPS181
FP16 TFLOPS181
FP8 TFLOPS181
INT8 TOPS181
TDP300W
InterconnectINFINITY-FABRIC
Max per Node4
PCIe Gen4
Tensor CoresNo

Pricing by Provider

ProviderOn-DemandReservedSpotBadge
lambda$0.99/hr--Cheapest

Compatible Models (235)

Training Capabilities

Estimated GPU count for full fine-tuning (AdamW, BF16) and QLoRA

Model SizeFull Fine-TuneQLoRA
7B model3 GPUs1 GPU
13B model4 GPUs1 GPU
70B model21 GPUs1 GPU

Energy Efficiency

Estimated tokens/second per Watt for popular models

Mistral 7B
0.75 t/s/WFP8
Qwen 2.5 7B
0.72 t/s/WFP8
Llama 3.1 8B
0.68 t/s/WFP8
Llama 3.1 70B
0.08 t/s/WFP8
Qwen 2.5 72B
0.08 t/s/WFP8

Similar GPUs

GPUVRAMBF16 TFLOPSBW (GB/s)From
Instinct MI250X128 GB3833277$0.79/hr
A1664 GB16.8232$0.72/hr
H100 SXM80 GB9903350$1.89/hr
H100 PCIe80 GB7562000$1.89/hr
A100 80GB SXM80 GB3122039$1.19/hr