Skip to content
Updated minutes ago
ReleasedMarch 12, 2025Verified 1mo ago · huggingface.co
Google

Gemma 3 27B

Google · dense · 27B parameters · 131,072 context

Quality
69.0

Parameters

27B

Context Window

128K tokens

Architecture

Dense

Best GPU

H20

Cheapest API

$0.00/M

Quality Score

69/100

Intelligence Brief

Gemma 3 27B is a 27B parameter DENSE model from Google, featuring Grouped Query Attention (GQA) with 62 layers and 3,584 hidden dimensions. With a 131,072 token context window, it supports tools, vision, structured output, code, math, multilingual. On standardized benchmarks, it achieves MMLU 78, HumanEval 48, GSM8K 85. The most cost-effective API deployment is via featherless at $0.00/M output tokens. For self-hosted inference, H20 delivers optimal throughput at $940/month.

Provider pricing

5 providers · canonical: google
Provider Input $/M Output $/M Notes
featherlessfreefreecheapest input · cheapest output
scalewayfreefreecheapest input · cheapest output
openrouter$0.080$0.160
googlecanonical$0.100$0.200
together$0.300$0.300

Prices update via the nightly pricing cron + admin approvals at /admin/ingest-queue. The leaderboard's Input/Output cells show the canonical rate above; this table shows the full spread.

Recent changes

Loading…

Related models

5 suggestions

Picks: same family first, then same vendor within ±2× params, then top tag-overlap matches. Price shown is the cheapest Output $/M across providers — the row's page shows the canonical anchor.

Architecture Details

TypeDENSE
Total Parameters27B
Active Parameters27B
Layers62
Hidden Dimension3,584
Attention Heads32
KV Heads16
Head Dimension128
Vocab Size262,144

Memory Requirements

BF16 Weights

54.0 GB

FP8 Weights

27.0 GB

INT4 Weights

13.5 GB

KV-Cache per Token507904 bytes
Activation Estimate1.50 GB

GPU Compatibility Matrix

Gemma 3 27B is compatible with 62% of GPU configurations across 41 GPUs at 3 precision levels.

BF16 (Full)
FP8 (Half)
INT4 (Quarter)
Blackwell(7 GPUs)
B200 NVL (pair)360GB
B300288GB
B100 SXM192GB
GB200 NVL72 (per GPU)192GB
Hopper(7 GPUs)
H100 NVL 94GB (per GPU pair)188GB
H200 SXM141GB
H2096GB
GH20096GB
Ada Lovelace(11 GPUs)
L40S48GB
L4048GB
RTX 6000 Ada48GB
L2048GB
Ampere(16 GPUs)
A100 80GB SXM80GB
A100 80GB PCIe80GB
A1664GB
RTX A600048GB
Legend:No fitVery tightTightModerateGoodExcellent

GPU Recommendations

H20optimal

FP8 · 1 GPU · tensorrt-llm

100/100

score

Throughput

1.1K tok/s

Latency (ITL)

1.0ms

Est. TTFT

0ms

Cost/Month

$940

Cost/M Tokens

$0.34

Use this config →
H200 SXMoptimal

FP8 · 1 GPU · tensorrt-llm

95/100

score

Throughput

1.1K tok/s

Latency (ITL)

1.0ms

Est. TTFT

0ms

Cost/Month

$2553

Cost/M Tokens

$0.93

Use this config →
H100 SXMoptimal

FP8 · 1 GPU · tensorrt-llm

95/100

score

Throughput

1.0K tok/s

Latency (ITL)

1.0ms

Est. TTFT

0ms

Cost/Month

$1794

Cost/M Tokens

$0.66

Use this config →

Deployment Options

API

API Deployment

featherless

$0.00/M

output tokens

Self-Hosted

Single GPU

H20

$940/mo

Min VRAM: 27 GB

Scale

Multi-GPU

A100 40GB SXM x2

306.1 tok/s

TP· $1613/mo

API Pricing Comparison

ProviderInput $/MOutput $/MBadges
featherless$0.00$0.00
Cheapest
scaleway$0.00$0.00
openrouter$0.08$0.16
google$0.10$0.20
together$0.30$0.30

Cost Analysis

ProviderInput $/MOutput $/M~Monthly Cost
featherlessBest Value$0.00$0.00$0
scaleway$0.00$0.00$0
openrouter$0.08$0.16$1
google$0.10$0.20$2
together$0.30$0.30$3

Cost per 1,000 Requests

Short (500 tok)

$0.00

via featherless

Medium (2K tok)

$0.00

via featherless

Long (8K tok)

$0.00

via featherless

Performance Estimates

Throughput by GPU

H20
1.1K tok/s
H200 SXM
1.1K tok/s
H100 SXM
1.0K tok/s

VRAM Breakdown (H20, FP8)

Weights
Act
Weights 27.0 GBKV-Cache 4.2 GBActivations 12.0 GBOverhead 1.4 GB

Precision Impact

bf16

54.0 GB

weights/GPU

fp8

27.0 GB

weights/GPU

~1.1K tok/s

int4

13.5 GB

weights/GPU

Quality Benchmarks

Average
73th percentile across all models
MMLU
78.0
Below Average (48th pctile)
HumanEval
48.0
Below Average (41th pctile)
GSM8K
85.0
Average (52th pctile)
MT-Bench
82.0
Bottom 25% (0th pctile)

Capabilities

Features

Tool Use Vision Code Math Reasoning Multilingual Structured Output

Supported Frameworks

vllmsglangtgitensorrt-llmollama

Supported Precisions

BF16 (default)FP8INT4

Where to Deploy Gemma 3 27B

Similar Models

Gemma 3 12B

12B params · dense

Quality: 71

from $0.10/M

More expensive, Smaller modelCompare →

Gemma 2 27B

27B params · dense

Quality: 65

from $0.00/M

Smaller contextCompare →
Smaller context, Lower qualityCompare →

Claude Haiku 4.5

30B params · moe

Quality: 50

from $5.00/M

Larger context, Lower quality, More expensiveCompare →
Smaller context, Lower qualityCompare →

Frequently Asked Questions

How much VRAM does Gemma 3 27B need for inference?

Gemma 3 27B requires approximately 54.0 GB of VRAM at BF16 precision, 27.0 GB at FP8, or 13.5 GB at INT4 quantization. Additional VRAM is needed for KV-cache (507904 bytes per token) and activations (~1.50 GB).

What is the best GPU for Gemma 3 27B?

The top recommended GPU for Gemma 3 27B is the H20 using FP8 precision. It achieves approximately 1.1K tokens/sec at an estimated cost of $940/month ($0.34/M tokens). Score: 100/100.

How much does Gemma 3 27B inference cost?

Gemma 3 27B API inference starts from $0.00/M input tokens and $0.00/M output tokens. Self-hosted inference costs depend on your GPU configuration — use our ROI calculator for a detailed breakdown.