Skip to content
Updated minutes ago
Cohere

Command R 7B

Cohere · dense · 7B parameters · 131,072 context

Quality
68.0

Parameters

7B

Context Window

128K tokens

Architecture

Dense

Best GPU

A10G

Cheapest API

$0.15/M

Quality Score

68/100

Intelligence Brief

Command R 7B is a 7B parameter DENSE model from Cohere, featuring Grouped Query Attention (GQA) with 32 layers and 4,096 hidden dimensions. With a 131,072 token context window, it supports tools, structured output, code, multilingual. On standardized benchmarks, it achieves MMLU 73, HumanEval 42, GSM8K 75. The most cost-effective API deployment is via cohere at $0.15/M output tokens. For self-hosted inference, A10G delivers optimal throughput at $285/month.

Architecture Details

TypeDENSE
Total Parameters7B
Active Parameters7B
Layers32
Hidden Dimension4,096
Attention Heads32
KV Heads8
Head Dimension128
Vocab Size256,000

Memory Requirements

BF16 Weights

14.0 GB

FP8 Weights

7.0 GB

INT4 Weights

3.5 GB

KV-Cache per Token131072 bytes
Activation Estimate0.80 GB

GPU Compatibility Matrix

Command R 7B is compatible with 95% of GPU configurations across 41 GPUs at 3 precision levels.

BF16 (Full)
FP8 (Half)
INT4 (Quarter)
Blackwell(7 GPUs)
B200 NVL (pair)360GB
B300288GB
B100 SXM192GB
GB200 NVL72 (per GPU)192GB
Hopper(7 GPUs)
H100 NVL 94GB (per GPU pair)188GB
H200 SXM141GB
H2096GB
GH20096GB
Ada Lovelace(11 GPUs)
L40S48GB
L4048GB
RTX 6000 Ada48GB
L2048GB
Ampere(16 GPUs)
A100 80GB SXM80GB
A100 80GB PCIe80GB
A1664GB
RTX A600048GB
Legend:No fitVery tightTightModerateGoodExcellent

GPU Recommendations

A10Goptimal

BF16 · 1 GPU · vllm

100/100

score

Throughput

231.4 tok/s

Latency (ITL)

4.3ms

Est. TTFT

1ms

Cost/Month

$285

Cost/M Tokens

$0.47

Use this config →
A30optimal

BF16 · 1 GPU · vllm

100/100

score

Throughput

359.9 tok/s

Latency (ITL)

2.8ms

Est. TTFT

0ms

Cost/Month

$332

Cost/M Tokens

$0.35

Use this config →
RTX 4090optimal

BF16 · 1 GPU · vllm

100/100

score

Throughput

388.8 tok/s

Latency (ITL)

2.6ms

Est. TTFT

0ms

Cost/Month

$370

Cost/M Tokens

$0.36

Use this config →

Deployment Options

API

API Deployment

cohere

$0.15/M

output tokens

Self-Hosted

Single GPU

A10G

$285/mo

Min VRAM: 7 GB

Scale

Multi-GPU

RTX 3080 x2

452.6 tok/s

TP· $266/mo

API Pricing Comparison

ProviderInput $/MOutput $/MBadges
cohere$0.07$0.15
Cheapest

Cost Analysis

ProviderInput $/MOutput $/M~Monthly Cost
cohereBest Value$0.07$0.15$1

Cost per 1,000 Requests

Short (500 tok)

$0.07

via cohere

Medium (2K tok)

$0.27

via cohere

Long (8K tok)

$0.90

via cohere

Performance Estimates

Throughput by GPU

A10G
231.4 tok/s
A30
359.9 tok/s
RTX 4090
388.8 tok/s

VRAM Breakdown (A10G, BF16)

Weights
Act
Weights 14.0 GBKV-Cache 2.1 GBActivations 6.4 GBOverhead 1.1 GB

Precision Impact

bf16

14.0 GB

weights/GPU

~231.4 tok/s

fp8

7.0 GB

weights/GPU

int4

3.5 GB

weights/GPU

Quality Benchmarks

Average
71th percentile across all models
MMLU
73.0
Below Average (41th pctile)
HumanEval
42.0
Below Average (30th pctile)
GSM8K
75.0
Below Average (36th pctile)
MT-Bench
78.0
Bottom 25% (0th pctile)

Capabilities

Features

Tool Use Vision Code Math Reasoning Multilingual Structured Output

Supported Frameworks

vllmsglangtgitensorrt-llmollama

Supported Precisions

BF16 (default)FP8INT4

Where to Deploy Command R 7B

Similar Models

Smaller context, Lower qualityCompare →

Falcon 7B

7B params · dense

Quality: 37

from $0.15/M

Smaller context, Lower qualityCompare →
Smaller context, Lower qualityCompare →
Smaller context, Lower qualityCompare →

Code Llama 7B

7B params · dense

Quality: 39

from $0.20/M

Smaller context, Lower qualityCompare →

Frequently Asked Questions

How much VRAM does Command R 7B need for inference?

Command R 7B requires approximately 14.0 GB of VRAM at BF16 precision, 7.0 GB at FP8, or 3.5 GB at INT4 quantization. Additional VRAM is needed for KV-cache (131072 bytes per token) and activations (~0.80 GB).

What is the best GPU for Command R 7B?

The top recommended GPU for Command R 7B is the A10G using BF16 precision. It achieves approximately 231.4 tokens/sec at an estimated cost of $285/month ($0.47/M tokens). Score: 100/100.

How much does Command R 7B inference cost?

Command R 7B API inference starts from $0.07/M input tokens and $0.15/M output tokens. Self-hosted inference costs depend on your GPU configuration — use our ROI calculator for a detailed breakdown.