Updated minutes ago
V100 16GB
nvidia · volta · 16 GB HBM2 · 250W TDP
VRAM
16 GB
BF16 TFLOPS
28.3
Bandwidth
900 GB/s
From
$0.15/hr
Spec Sheet
VRAM16 GB HBM2
Memory Bandwidth900 GB/s
BF16 TFLOPS28.3
FP16 TFLOPS28.3
FP8 TFLOPS28.3
INT8 TOPS56.5
TDP250W
InterconnectNVLINK
NVLink Bandwidth300 GB/s
Max per Node8
PCIe Gen3
CUDA Compute Capability7
Tensor CoresYes
Pricing by Provider
| Provider | On-Demand | Reserved | Spot | Badge |
|---|---|---|---|---|
| vast_ai | $0.29/hr | - | $0.15/hr | Cheapest |
| tensordock | $0.25/hr | - | $0.15/hr | |
| runpod | $0.39/hr | - | $0.25/hr | |
| aws | $3.06/hr | $1.96/hr | $0.92/hr | |
| gcp | $2.48/hr | $1.58/hr | - |
Compatible Models (222)
Single GPU (134 models)
OLMo 2 13B13B FP8Baichuan 2 13B13B FP8Vicuna 13B13B FP8Code Llama 13B13B FP8Llama 2 13B13B FP8Orca 2 13B13B FP8VILA 1.5 13B13B FP8ELYZA 13B13B FP8Cerebras GPT 13B13B FP8KULLM 12.8B12.8B FP8StableLM 2 12B12.1B FP8Amazon Nova Lite12B FP8Gemma 3 12B12B FP8Mistral Nemo 12B12B FP8Pixtral 12B12B FP8FLUX.1 Dev12B FP8Llama 3.2 11B Vision11B FP8Falcon 11B11B FP8SOLAR 10.7B10.7B FP8GLM-4 9B9.4B FP8+114 more
Multi-GPU (88 models)
Gemma 2 27Bx2 FP8Gemma 3 27Bx2 FP8InternVL2 26Bx2 FP8Mistral Small 24Bx2 FP8Mistral Small 3.1 24Bx2 FP8Codestral 22Bx2 FP8Solar Pro 22Bx2 FP8GigaChat 20Bx2 FP8InternLM 20Bx2 FP8InternLM 2.5 20Bx2 FP8CogVLM2 19Bx2 FP8DeepSeek MoE 16Bx2 FP8CodeGen2 16Bx2 FP8DeepSeek V2 Litex2 FP8OctoCoder 15Bx2 FP8+73 more
Training Capabilities
Estimated GPU count for full fine-tuning (AdamW, BF16) and QLoRA
| Model Size | Full Fine-Tune | QLoRA |
|---|---|---|
| 7B model | 9 GPUs | 1 GPU |
| 13B model | 16 GPUs | 1 GPU |
| 70B model | 83 GPUs | 3 GPUs |
Energy Efficiency
Estimated tokens/second per Watt for popular models
Mistral 7B
0.49 t/s/WFP8
Qwen 2.5 7B
0.47 t/s/WFP8
Llama 3.1 8B
0.45 t/s/WFP8
Llama 3.1 70B
0.05 t/s/WFP8
Qwen 2.5 72B
0.05 t/s/WFP8
Similar GPUs
| GPU | VRAM | BF16 TFLOPS | BW (GB/s) | From |
|---|---|---|---|---|
| V100 32GB | 32 GB | 28.3 | 900 | $0.19/hr |
| A4000 | 16 GB | 76 | 448 | $0.17/hr |
| RTX 4080 | 16 GB | 97 | 717 | $0.32/hr |
| T4 | 16 GB | 65 | 300 | $0.12/hr |
| RTX 4060 Ti 16GB | 16 GB | 44 | 288 | $0.30/hr |