Skip to content
Updated minutes ago
Mistral

Mistral Medium 3

Mistral AI · dense · 70B parameters · 131,072 context

Quality
80.0

Parameters

70B

Context Window

128K tokens

Architecture

Dense

Best GPU

H200 SXM

Cheapest API

$6.00/M

Quality Score

80/100

Intelligence Brief

Mistral Medium 3 is a 70B parameter DENSE model from Mistral AI, featuring Grouped Query Attention (GQA) with 80 layers and 8,192 hidden dimensions. With a 131,072 token context window, it supports tools, structured output, code, math, multilingual, reasoning. On standardized benchmarks, it achieves MMLU 82, HumanEval 58, GSM8K 88. The most cost-effective API deployment is via mistral at $6.00/M output tokens. For self-hosted inference, H200 SXM delivers optimal throughput at $2553/month.

Architecture Details

TypeDENSE
Total Parameters70B
Active Parameters70B
Layers80
Hidden Dimension8,192
Attention Heads64
KV Heads8
Head Dimension128
Vocab Size131,072

Memory Requirements

BF16 Weights

140.0 GB

FP8 Weights

70.0 GB

INT4 Weights

35.0 GB

KV-Cache per Token655360 bytes
Activation Estimate3.00 GB

GPU Compatibility Matrix

Mistral Medium 3 is compatible with 38% of GPU configurations across 41 GPUs at 3 precision levels.

BF16 (Full)
FP8 (Half)
INT4 (Quarter)
Blackwell(7 GPUs)
B200 NVL (pair)360GB
B300288GB
B100 SXM192GB
GB200 NVL72 (per GPU)192GB
Hopper(7 GPUs)
H100 NVL 94GB (per GPU pair)188GB
H200 SXM141GB
H2096GB
GH20096GB
Ada Lovelace(11 GPUs)
L40S48GB
L4048GB
RTX 6000 Ada48GB
L2048GB
Ampere(16 GPUs)
A100 80GB SXM80GB
A100 80GB PCIe80GB
A1664GB
RTX A600048GB
Legend:No fitVery tightTightModerateGoodExcellent

GPU Recommendations

H200 SXMoptimal

FP8 · 1 GPU · tensorrt-llm

100/100

score

Throughput

560.0 tok/s

Latency (ITL)

1.8ms

Est. TTFT

0ms

Cost/Month

$2553

Cost/M Tokens

$1.73

Use this config →
H20optimal

FP8 · 1 GPU · tensorrt-llm

100/100

score

Throughput

478.0 tok/s

Latency (ITL)

2.1ms

Est. TTFT

0ms

Cost/Month

$940

Cost/M Tokens

$0.75

Use this config →
GH200optimal

FP8 · 1 GPU · tensorrt-llm

100/100

score

Throughput

478.0 tok/s

Latency (ITL)

2.1ms

Est. TTFT

0ms

Cost/Month

$2838

Cost/M Tokens

$2.26

Use this config →

Deployment Options

API

API Deployment

mistral

$6.00/M

output tokens

Self-Hosted

Single GPU

H200 SXM

$2553/mo

Min VRAM: 70 GB

Scale

Multi-GPU

H100 SXM x2

560.0 tok/s

TP· $3587/mo

API Pricing Comparison

ProviderInput $/MOutput $/MBadges
mistral$2.00$6.00
Cheapest

Cost Analysis

ProviderInput $/MOutput $/M~Monthly Cost
mistralBest Value$2.00$6.00$40

Cost per 1,000 Requests

Short (500 tok)

$2.20

via mistral

Medium (2K tok)

$8.80

via mistral

Long (8K tok)

$28.00

via mistral

Performance Estimates

Throughput by GPU

H200 SXM
560.0 tok/s
H20
478.0 tok/s
GH200
478.0 tok/s

VRAM Breakdown (H200 SXM, FP8)

Weights
Act
Weights 70.0 GBKV-Cache 2.7 GBActivations 24.0 GBOverhead 3.5 GB

Precision Impact

bf16

140.0 GB

weights/GPU

fp8

70.0 GB

weights/GPU

~560.0 tok/s

int4

35.0 GB

weights/GPU

Quality Benchmarks

Above Average
86th percentile across all models
MMLU
82.0
Average (61th pctile)
HumanEval
58.0
Average (67th pctile)
GSM8K
88.0
Average (62th pctile)
MT-Bench
84.0
Bottom 25% (0th pctile)

Capabilities

Features

Tool Use Vision Code Math Reasoning Multilingual Structured Output

Supported Frameworks

vllmsglangtgitensorrt-llm

Supported Precisions

BF16 (default)FP8INT4

Where to Deploy Mistral Medium 3

Similar Models

Code Llama 70B

70B params · dense

Quality: 60

from $0.90/M

Smaller context, Lower quality, CheaperCompare →

Llama 2 70B

70B params · dense

Quality: 62

from $0.90/M

Smaller context, Lower quality, CheaperCompare →
Smaller context, Lower qualityCompare →

Claude Sonnet 4

70B params · dense

Quality: 86

from $15.00/M

Larger context, Higher quality, More expensiveCompare →

o1-mini

70B params · dense

Quality: 83

from $12.00/M

More expensiveCompare →

Frequently Asked Questions

How much VRAM does Mistral Medium 3 need for inference?

Mistral Medium 3 requires approximately 140.0 GB of VRAM at BF16 precision, 70.0 GB at FP8, or 35.0 GB at INT4 quantization. Additional VRAM is needed for KV-cache (655360 bytes per token) and activations (~3.00 GB).

What is the best GPU for Mistral Medium 3?

The top recommended GPU for Mistral Medium 3 is the H200 SXM using FP8 precision. It achieves approximately 560.0 tokens/sec at an estimated cost of $2553/month ($1.73/M tokens). Score: 100/100.

How much does Mistral Medium 3 inference cost?

Mistral Medium 3 API inference starts from $2.00/M input tokens and $6.00/M output tokens. Self-hosted inference costs depend on your GPU configuration — use our ROI calculator for a detailed breakdown.