RTX 5090 vs Tesla V100 x2
Best sourced output tok/s per model (single-stream generation) — engine and version, quantization, context and a source link on every row. Hover a value for the quant.
RTX 509027 sourced runs · best 446.7 tok/s
Tesla V100 x25 verified runs · best 96.1 tok/s
Specs and evidence
| RTX 5090 | Tesla V100 x2 | |
|---|---|---|
| VRAM | 32 GB | 32 GB |
| Sourced runs on the board | 27 | 5 |
| Models measured | 17 | 3 |
| Best output tok/s | 446.7 tok/s | 96.1 tok/s |
| Highest measured peak VRAM | 31.3 GB | 25.2 GB |
| Street price (latest snapshot) | — | — |
Head-to-head
On the 2 models measured on both cards, RTX 5090 leads on 2, Tesla V100 x2 on 0. The widest gap is on Qwen3.8-27B: RTX 5090 435.1 tok/s vs Tesla V100 x2 24.0 tok/s (RTX 5090 1713% faster).
The measured matrix
| Model | RTX 5090 | Tesla V100 x2 |
|---|---|---|
| NVIDIA-Nemotron-3.5-Lightning-30B-A3B | 446.7 | — |
| Qwen3.8-27B | 435.1 | 24.0 |
| Ornith-1.0-35B-PrismaAURA-4.75bit-vllm-MTP | 283.1 | — |
| Kimi-Linear-48B-A3B-Instruct | 280.8 | — |
| Ornith-1.5-35B-A3B | 258.8 | 65.0 |
| North-Mini-Code-1.0 | 258.4 | — |
| Recursive Flint 40B | 224.8 | — |
| Qwen3.6-35B-A3B-MTP | 222.9 | — |
| Laguna-XS-2.1 | 216.7 | — |
| KAT-Coder-V2.5-Dev-AWQ-W4A16-ASYM | 201.2 | — |
| Ornith-1.0-35B | 196.6 | — |
| Muse-Glimmer-30B | 124.8 | — |
| Qwen3.6-27B | 120.9 | — |
| Huihui-Qwen3.8-27B-abliterated | 117.7 | — |
| Qwen3.8-Flash-Next | — | 96.1 |
| Qwen3.8-27B-5090-goldilocks | 93.5 | — |
| Qwen3.6-27B-MTP | 28.3 | — |
| DeepSeek-V4-Flash-0731 | 26.4 | — |