Skip to content
Updated minutes ago
Zhipu

GLM-5

Zhipu AI · dense · 200B parameters · 128,000 context

Quality
50.0

Parameters

200B

Context Window

125K tokens

Architecture

Dense

Best GPU

B200 SXM

Cheapest API

$6.00/M

Intelligence Brief

GLM-5 is a 200B parameter DENSE model from Zhipu AI, featuring Grouped Query Attention (GQA) with 80 layers and 12,288 hidden dimensions. With a 128,000 token context window, it supports tools, vision, structured output, code, math, multilingual, reasoning. The most cost-effective API deployment is via zhipu at $6.00/M output tokens. For self-hosted inference, B200 SXM delivers optimal throughput at $8522/month.

Architecture Details

TypeDENSE
Total Parameters200B
Active Parameters200B
Layers80
Hidden Dimension12,288
Attention Heads96
KV Heads8
Head Dimension128
Vocab Size152,064

Memory Requirements

BF16 Weights

400.0 GB

FP8 Weights

200.0 GB

INT4 Weights

100.0 GB

KV-Cache per Token327680 bytes
Activation Estimate4.00 GB

GPU Compatibility Matrix

GLM-5 is compatible with 8% of GPU configurations across 41 GPUs at 3 precision levels.

BF16 (Full)
FP8 (Half)
INT4 (Quarter)
Blackwell(7 GPUs)
B200 NVL (pair)360GB
B300288GB
B100 SXM192GB
GB200 NVL72 (per GPU)192GB
Hopper(7 GPUs)
H100 NVL 94GB (per GPU pair)188GB
H200 SXM141GB
H2096GB
GH20096GB
Ada Lovelace(11 GPUs)
L40S48GB
L4048GB
RTX 6000 Ada48GB
L2048GB
Ampere(16 GPUs)
A100 80GB SXM80GB
A100 80GB PCIe80GB
A1664GB
RTX A600048GB
Legend:No fitVery tightTightModerateGoodExcellent

GPU Recommendations

B200 SXMoptimal

FP8 · 2 GPUs · tensorrt-llm

98/100

score

Throughput

280.0 tok/s

Latency (ITL)

3.6ms

Est. TTFT

1ms

Cost/Month

$8522

Cost/M Tokens

$11.58

Use this config →
B100 SXMoptimal

FP8 · 2 GPUs · tensorrt-llm

98/100

score

Throughput

280.0 tok/s

Latency (ITL)

3.6ms

Est. TTFT

1ms

Cost/Month

$8541

Cost/M Tokens

$11.61

Use this config →
H200 SXMoptimal

FP8 · 2 GPUs · tensorrt-llm

95/100

score

Throughput

280.0 tok/s

Latency (ITL)

3.6ms

Est. TTFT

1ms

Cost/Month

$5106

Cost/M Tokens

$6.94

Use this config →

Deployment Options

API

API Deployment

zhipu

$6.00/M

output tokens

Self-Hosted

Single GPU

B200 NVL (pair)

$9965/mo

Min VRAM: 200 GB

Scale

Multi-GPU

B200 SXM x2

280.0 tok/s

TP· $8522/mo

API Pricing Comparison

ProviderInput $/MOutput $/MBadges
zhipu$2.00$6.00
Cheapest

Cost Analysis

ProviderInput $/MOutput $/M~Monthly Cost
zhipuBest Value$2.00$6.00$40

Cost per 1,000 Requests

Short (500 tok)

$2.20

via zhipu

Medium (2K tok)

$8.80

via zhipu

Long (8K tok)

$28.00

via zhipu

Performance Estimates

Throughput by GPU

B200 SXM
280.0 tok/s
B100 SXM
280.0 tok/s
H200 SXM
280.0 tok/s

VRAM Breakdown (B200 SXM, FP8)

Weights
Act
Weights 100.0 GBKV-Cache 2.7 GBActivations 32.0 GBOverhead 5.0 GB

Precision Impact

bf16

200.0 GB

weights/GPU

fp8

100.0 GB

weights/GPU

~280.0 tok/s

int4

50.0 GB

weights/GPU

Capabilities

Features

Tool Use Vision Code Math Reasoning Multilingual Structured Output

Supported Frameworks

vllmsglangtgi

Supported Precisions

BF16 (default)FP8INT4

Where to Deploy GLM-5

Similar Models

Claude Opus 4

200B params · dense

Quality: 90

from $75.00/M

Larger context, Higher quality, More expensiveCompare →

GPT-4o

200B params · moe

Quality: 85

from $10.00/M

Higher quality, More expensiveCompare →

GPT-4 Turbo

200B params · moe

Quality: 80

from $30.00/M

Higher quality, More expensiveCompare →

o1

200B params · moe

Quality: 93

from $60.00/M

Larger context, Higher quality, More expensiveCompare →

Yi-Lightning

200B params · moe

Quality: 50

from $0.99/M

Smaller context, CheaperCompare →

Frequently Asked Questions

How much VRAM does GLM-5 need for inference?

GLM-5 requires approximately 400.0 GB of VRAM at BF16 precision, 200.0 GB at FP8, or 100.0 GB at INT4 quantization. Additional VRAM is needed for KV-cache (327680 bytes per token) and activations (~4.00 GB).

What is the best GPU for GLM-5?

The top recommended GPU for GLM-5 is the B200 SXM (x2) using FP8 precision. It achieves approximately 280.0 tokens/sec at an estimated cost of $8522/month ($11.58/M tokens). Score: 98/100.

How much does GLM-5 inference cost?

GLM-5 API inference starts from $2.00/M input tokens and $6.00/M output tokens. Self-hosted inference costs depend on your GPU configuration — use our ROI calculator for a detailed breakdown.