Skip to content
Updated minutes ago
Nomic

Nomic Embed Text v1.5

Nomic AI · dense · 0.137B parameters · 8,192 context

Quality
50.0

Architecture Details

TypeDENSE
Total Parameters0.137B
Active Parameters0.137B
Layers12
Hidden Dimension768
Attention Heads12
KV Heads12
Head Dimension64
Vocab Size30,528

Memory Requirements

BF16 Weights

0.3 GB

FP8 Weights

0.1 GB

INT4 Weights

0.1 GB

KV-Cache per Token36864 bytes
Activation Estimate0.05 GB

Fits on (single-node)

B200 SXM BF16B100 SXM BF16GB200 NVL72 (per GPU) BF16GB300 NVL72 (per GPU) BF16H200 SXM BF16H100 SXM BF16H100 PCIe BF16H100 NVL BF16

GPU Recommendations

B200 SXMoptimal

FP8 · 1 GPU · tensorrt-llm

83/100

score

Throughput

3.5K tok/s

Cost/Month

$4261

Cost/M Tokens

$0.46

Use this config →
B100 SXMoptimal

FP8 · 1 GPU · tensorrt-llm

83/100

score

Throughput

3.5K tok/s

Cost/Month

$4271

Cost/M Tokens

$0.46

Use this config →
GB200 NVL72 (per GPU)optimal

FP8 · 1 GPU · tensorrt-llm

83/100

score

Throughput

3.5K tok/s

Cost/Month

$6169

Cost/M Tokens

$0.67

Use this config →

API Pricing Comparison

ProviderInput $/MOutput $/MBadges
nomic$0.01$0.01
Cheapest

Capabilities

Features

Tool Use Vision Code Math Reasoning Multilingual Structured Output

Supported Frameworks

vllmtgiollama

Supported Precisions

BF16 (default)FP8

Similar Models