Nemotron 3.5 Bolt E4B 4GB

Nemotron family · 4.0B params

1recorded run

116.0best tok/s

1verified

Evidence: 1 sourced run · 1 independent source · first recorded Oct 26, 2026. What these labels mean.

What the Nemotron 3.5 Bolt E4B 4GB numbers mean

The fastest verified result on our board is 116.0 output tok/s on an RTX 5070 12GB at Q4_K_M with a 4000-token context. That is about 8.6 ms per generated token — 500 tokens takes roughly 4.3 seconds.

How much VRAM does Nemotron 3.5 Bolt E4B 4GB need?

Nemotron 3.5 Bolt E4B 4GB has 4.0B parameters. These estimates use the same formula as the VRAM calculator: weights, plus about 15% for a moderate-context KV cache and runtime overhead, plus a small engine floor.

Quantisation	Estimated VRAM	Smallest card that fits
Q4_K_M (4-bit)	3.4 GB	8 GB
Q8_0 (8-bit)	5.7 GB	8 GB
FP16 (16-bit)	10.0 GB	12 GB

Long contexts and large batches raise the real number — read the smallest card as "possible with a reduced context". Measured throughput is on the benchmark board.

Fastest GPUs for this model (best tok/s)

RTX 5070 12GB116.0

Models with a similar footprint

Model	Params	Q4_K_M weights
gemma-3n-E4B-it-text	4B	2.2 GB
NVIDIA-Nemotron-3-Nano-4B	4B	2.2 GB
Phi-4-mini-reasoning	4B	2.2 GB
Qwen3-4B	4B	2.2 GB
Qwen3-4B-Thinking-2507	4B	2.2 GB
Qwen3.5-4B	4B	2.2 GB

Ranked by distance from Nemotron 3.5 Bolt E4B 4GB's parameter count. Full benchmark board.

All benchmarks Methodology

GPU	Model	Quant	Backend	Ctx	tok/s	prompt tok/s	VRAM GB	Source
RTX 5070 12GB · 12 GB	Nemotron 3.5 Bolt E4B 4GB	Q4_K_M	llama.cpp b11834	4000	116.0 ✓	—	—	src