Updated minutes ago
Instinct MI210
amd · cdna2 · 64 GB HBM2e · 300W TDP
VRAM
64 GB
BF16 TFLOPS
181
Bandwidth
1638 GB/s
From
$0.99/hr
Spec Sheet
VRAM64 GB HBM2e
Memory Bandwidth1638 GB/s
BF16 TFLOPS181
FP16 TFLOPS181
FP8 TFLOPS181
INT8 TOPS181
TDP300W
InterconnectINFINITY-FABRIC
Max per Node4
PCIe Gen4
Tensor CoresNo
Pricing by Provider
| Provider | On-Demand | Reserved | Spot | Badge |
|---|---|---|---|---|
| lambda | $0.99/hr | - | - | Cheapest |
Compatible Models (235)
Single GPU (185 models)
Jamba 1.5 Mini52B FP8Llama 3.1 Nemotron 51B51B FP8Amazon Nova Pro50B FP8Mixtral 8x7B46.7B FP8Mixtral 8x7B Instruct46.7B FP8Phi 3.5 MoE41.9B FP8Falcon 40B40B FP8VILA 1.5 40B40B FP8Aya 23 35B35B FP8Command R35B FP8Command R (August 2024)35B FP8Yi 1.5 34B34.4B FP8Code Llama 34B34B FP8DeepSeek Coder 33B33B FP8Vicuna 33B33B FP8WizardCoder 33B33B FP8DeepSeek R1 Distill 32B32.8B FP8Qwen 3 32B32.8B FP8Qwen 2.5 32B32.5B FP8Qwen 2.5 Coder 32B32.5B FP8+165 more
Multi-GPU (50 models)
Command R+x2 FP8Yi-Largex2 FP8YaLM 100Bx2 FP8Llama 3.2 90B Visionx2 FP8Llama 3.2 90B Vision Instructx2 FP8Qwen 2.5 72Bx2 FP8Qwen 2.5 Math 72Bx2 FP8Qwen 2.5 VL 72Bx2 FP8Dolphin 2.9 72Bx2 FP8DeepSeek R1 Distill 70Bx2 FP8Llama 3 70B 1M Contextx2 FP8Llama 3 70Bx2 FP8Llama 3.1 70Bx2 FP8Llama 3.3 70Bx2 FP8Hermes 3 70Bx2 FP8+35 more
Training Capabilities
Estimated GPU count for full fine-tuning (AdamW, BF16) and QLoRA
| Model Size | Full Fine-Tune | QLoRA |
|---|---|---|
| 7B model | 3 GPUs | 1 GPU |
| 13B model | 4 GPUs | 1 GPU |
| 70B model | 21 GPUs | 1 GPU |
Energy Efficiency
Estimated tokens/second per Watt for popular models
Mistral 7B
0.75 t/s/WFP8
Qwen 2.5 7B
0.72 t/s/WFP8
Llama 3.1 8B
0.68 t/s/WFP8
Llama 3.1 70B
0.08 t/s/WFP8
Qwen 2.5 72B
0.08 t/s/WFP8
Similar GPUs
| GPU | VRAM | BF16 TFLOPS | BW (GB/s) | From |
|---|---|---|---|---|
| Instinct MI250X | 128 GB | 383 | 3277 | $0.79/hr |
| A16 | 64 GB | 16.8 | 232 | $0.72/hr |
| H100 SXM | 80 GB | 990 | 3350 | $1.89/hr |
| H100 PCIe | 80 GB | 756 | 2000 | $1.89/hr |
| A100 80GB SXM | 80 GB | 312 | 2039 | $1.19/hr |