Updated minutes ago
DBRX Base
Databricks · moe · 132B parameters · 32,768 context
Quality50.0
Architecture Details
TypeMOE
Total Parameters132B
Active Parameters36B
Layers40
Hidden Dimension6,144
Attention Heads48
KV Heads8
Head Dimension128
Vocab Size100,352
Total Experts16
Active Experts4
Memory Requirements
BF16 Weights
264.0 GB
FP8 Weights
132.0 GB
INT4 Weights
66.0 GB
KV-Cache per Token163840 bytes
Activation Estimate2.00 GB
Fits on (single-node)
B200 SXM FP8B100 SXM FP8GB200 NVL72 (per GPU) FP8GB300 NVL72 (per GPU) FP8H200 SXM INT4H100 SXM INT4H100 PCIe INT4H100 NVL INT4
GPU Recommendations
B200 SXMoptimal
FP8 · 1 GPU · tensorrt-llm
100/100
score
Throughput
280.0 tok/s
Cost/Month
$4261
Cost/M Tokens
$5.79
B100 SXMoptimal
FP8 · 1 GPU · tensorrt-llm
100/100
score
Throughput
280.0 tok/s
Cost/Month
$4271
Cost/M Tokens
$5.80
GB200 NVL72 (per GPU)optimal
FP8 · 1 GPU · tensorrt-llm
100/100
score
Throughput
280.0 tok/s
Cost/Month
$6169
Cost/M Tokens
$8.38
API Pricing Comparison
| Provider | Input $/M | Output $/M | Badges |
|---|---|---|---|
| databricks | $0.75 | $2.25 | Cheapest |
Capabilities
Features
✗ Tool Use✗ Vision✓ Code✓ Math✗ Reasoning✗ Multilingual✗ Structured Output
Supported Frameworks
vllmsglangtgitensorrt-llm
Supported Precisions
BF16 (default)FP8INT4