Updated minutes ago
amd

Radeon PRO W7900

amd · rdna3 · 48 GB GDDR6 · 295W TDP

VRAM

48 GB

BF16 TFLOPS

122

Bandwidth

864 GB/s

From

$0.85/hr

Calculate ROI with this GPU →

Spec Sheet

VRAM48 GB GDDR6
Memory Bandwidth864 GB/s
BF16 TFLOPS122
FP16 TFLOPS122
FP8 TFLOPS122
INT8 TOPS122
TDP295W
InterconnectPCIE
Max per Node1
PCIe Gen4
Tensor CoresNo

Pricing by Provider

ProviderOn-DemandReservedSpotBadge
retail$0.85/hr--Cheapest

Compatible Models (205)

Single GPU (205 models)

Qwen 2.5 72B72.7B INT4Qwen 2.5 Math 72B72.7B INT4Qwen 2.5 VL 72B72.7B INT4Dolphin 2.9 72B72B INT4DeepSeek R1 Distill 70B70.6B INT4Llama 3 70B 1M Context70.6B INT4Llama 3 70B70.6B INT4Llama 3.1 70B70.6B INT4Llama 3.3 70B70.6B INT4Hermes 3 70B70.6B INT4HelpSteer2 Llama 3.1 70B70.6B INT4Llama 3.1 Nemotron 70B Instruct70.6B INT4Llama 3.1 Nemotron 70B Reward70.6B INT4Nemotron 70B70.6B INT4Llama 3.1 70B Turbo70.6B INT4Code Llama 70B70B INT4Llama 2 70B70B INT4WizardMath 70B70B INT4Meditron 70B70B INT4Japanese StableLM 70B70B INT4+185 more

Training Capabilities

Estimated GPU count for full fine-tuning (AdamW, BF16) and QLoRA

Model SizeFull Fine-TuneQLoRA
7B model3 GPUs1 GPU
13B model6 GPUs1 GPU
70B model28 GPUs1 GPU
Train on this GPU →

Energy Efficiency

Estimated tokens/second per Watt for popular models

Mistral 7B
0.40 t/s/WFP8
Qwen 2.5 7B
0.39 t/s/WFP8
Llama 3.1 8B
0.36 t/s/WFP8

Similar GPUs

GPUVRAMBF16 TFLOPSBW (GB/s)From
RX 7900 XTX24 GB123960$0.20/hr
RTX A600048 GB38.7768$0.49/hr
A4048 GB37.4696$0.42/hr
L40S48 GB362864$0.85/hr
L4048 GB362864$0.75/hr