Updated minutes ago
intel

Gaudi 3

intel · gaudi · 128 GB HBM2e · 900W TDP

VRAM

128 GB

BF16 TFLOPS

1835

Bandwidth

3700 GB/s

From

$2.30/hr

Calculate ROI with this GPU →

Spec Sheet

VRAM128 GB HBM2e
Memory Bandwidth3700 GB/s
BF16 TFLOPS1835
FP16 TFLOPS1835
FP8 TFLOPS3670
INT8 TOPS3670
TDP900W
InterconnectOAM
Max per Node8
PCIe Gen5
Tensor CoresNo

Pricing by Provider

ProviderOn-DemandReservedSpotBadge
gcp$3.20/hr$2.30/hr-Cheapest
aws$3.78/hr$2.65/hr-

Compatible Models (249)

Single GPU (215 models)

Command R+104B FP8Yi-Large102.6B FP8YaLM 100B100B FP8Llama 3.2 90B Vision90B FP8Llama 3.2 90B Vision Instruct88.8B FP8Qwen 2.5 72B72.7B FP8Qwen 2.5 Math 72B72.7B FP8Qwen 2.5 VL 72B72.7B FP8Dolphin 2.9 72B72B FP8DeepSeek R1 Distill 70B70.6B FP8Llama 3 70B 1M Context70.6B FP8Llama 3 70B70.6B FP8Llama 3.1 70B70.6B FP8Llama 3.3 70B70.6B FP8Hermes 3 70B70.6B FP8HelpSteer2 Llama 3.1 70B70.6B FP8Llama 3.1 Nemotron 70B Instruct70.6B FP8Llama 3.1 Nemotron 70B Reward70.6B FP8Nemotron 70B70.6B FP8Llama 3.1 70B Turbo70.6B FP8+195 more

Training Capabilities

Estimated GPU count for full fine-tuning (AdamW, BF16) and QLoRA

Model SizeFull Fine-TuneQLoRA
7B model2 GPUs1 GPU
13B model2 GPUs1 GPU
70B model11 GPUs1 GPU
Train on this GPU →

Energy Efficiency

Estimated tokens/second per Watt for popular models

Mistral 7B
0.56 t/s/WFP8
Qwen 2.5 7B
0.54 t/s/WFP8
Llama 3.1 8B
0.51 t/s/WFP8
DeepSeek V3
0.11 t/s/WFP8
Llama 3.1 70B
0.06 t/s/WFP8
Qwen 2.5 72B
0.06 t/s/WFP8

Similar GPUs

GPUVRAMBF16 TFLOPSBW (GB/s)From
Gaudi 3 HL-325L128 GB18353700$2.65/hr
Gaudi 296 GB4322460$1.65/hr
Instinct MI250X128 GB3833277$0.79/hr
H200 SXM141 GB9904800$2.69/hr
H2096 GB1484000$0.99/hr