RTX 3090 vs RTX PRO 6000 Blackwell
Best sourced output tok/s per model (single-stream generation) — engine and version, quantization, context and a source link on every row. Hover a value for the quant.
RTX 309018 sourced runs · best 709.5 tok/s
RTX PRO 6000 Blackwell29 verified runs · best 1271.3 tok/s
Specs and evidence
| RTX 3090 | RTX PRO 6000 Blackwell | |
|---|---|---|
| VRAM | 24 GB | 96 GB |
| Sourced runs on the board | 18 | 29 |
| Models measured | 11 | 23 |
| Best output tok/s | 709.5 tok/s | 1271.3 tok/s |
| Highest measured peak VRAM | 22.0 GB | 72.7 GB |
| Street price (latest snapshot) | $1,720 | — |
Head-to-head
Only one model has been measured on both cards (Qwen3.8-27B). On that single data point RTX 3090 records 164.6 tok/s and RTX PRO 6000 Blackwell records 296.0 tok/s — treat it as one data point, not a ranking.
The measured matrix
| Model | RTX 3090 | RTX PRO 6000 Blackwell |
|---|---|---|
| MobileLLM-125M | — | 1271.3 |
| Qwen2.5-0.5B-Instruct | — | 1060.0 |
| MobileLLM-350M | — | 980.8 |
| SmolLM2-360M-Instruct | — | 968.1 |
| Qwen3-0.6B | — | 956.4 |
| LFM2.5-1.2B-Instruct | 709.5 | — |
| Llama-3.2-1B-Instruct | — | 699.9 |
| gemma-3-1b-it | — | 664.3 |
| Llama-3.2-3B-Instruct | — | 489.2 |
| Qwen3.5-0.8B-MTP | 476.1 | — |
| Ling-3.0-tiny | — | 369.1 |
| NVIDIA-Nemotron-3.5-Lightning-30B-A3B | 353.7 | — |
| Qwen3.6-35B-A3B | — | 330.2 |
| Ornith-1.0-35B | — | 309.7 |
| LFM2.5-2.6B | 305.6 | — |
| Qwen3.8-27B | 164.6 | 296.0 |
| Qwen3.5-4B-MTP | 240.4 | — |
| DeepSeek-Coder-V2-Lite-Instruct | — | 237.3 |
| Qwen3-Coder-Next | — | 174.3 |
| Qwen3.5-9B-MTP | 164.3 | — |
| Llama-3.1-8B-Instruct | — | 158.1 |
| Muse-Glimmer-30B | — | 152.2 |
| Qwen3.8-27B-MTP | — | 112.1 |
| Qwen3.6-27B | — | 101.4 |
| Qwen3-14B | — | 90.8 |
| Kimi-Linear-48B-A3B-Instruct | — | 90.0 |
| Qwen3.6-27B-MTP | — | 60.1 |
| Qwen2.5-Coder-14B-Instruct | — | 50.3 |
| Qwen3.8-Flash-Next | 38.6 | — |
| Ornstein3.6-27B-MTP-NSC-ACE-SABER | 32.9 | — |
| GLM-5.3-Flash | 28.1 | — |
| Qwen3-Coder-30B-A3B-Instruct | — | 26.1 |
| DeepSeek-V4.1-Flash | 26.0 | — |