GPU Training ROI Calculator
Training & Fine-Tuning Calculator
Calculate GPU requirements and costs for 23 training methods across 60+ GPUs and 250+ models.
Fine-Tuning
Alignment
Merging
Pre-Training
Select a model and GPU in the sidebar to see results.
Reference Training Costs
| Model | Params | Tokens | GPUs | Duration | Est. Cost |
|---|---|---|---|---|---|
| GPT-3 175B | 175B | 300.0B | 10.0K V100 | 34d | $4.6M |
| Llama 2 70B | 70B | 2.0T | 2048 A100 80GB | 25d | $2.0M |
| Llama 3.1 405B | 405B | 15.0T | 16.4K H100 SXM | 54d | $30.0M |
| Llama 3.1 70B | 70B | 15.0T | 8192 H100 SXM | 25d | $5.0M |
| Mistral 7B | 7.3B | 8.0T | 512 A100 80GB | 20d | $500.0K |
| Qwen 2.5 72B | 72.7B | 18.0T | 4096 A100/H800 | 30d | $6.0M |
| DeepSeek V3 671B | 671B | 14.8T | 2048 H800 | 55d | $5.5M |