RTX 4090 vs Tesla V100 x2
Best sourced output tok/s per model (single-stream generation) — engine and version, quantization, context and a source link on every row. Hover a value for the quant.
Sourced data on this pair is thin — most of the board is still partial. Submit your own run and help fill the matrix: one prompt, three steps, no downloads.
RTX 40902 sourced runs · best 141.2 tok/s
Tesla V100 x25 verified runs · best 96.1 tok/s
Specs and evidence
| RTX 4090 | Tesla V100 x2 | |
|---|---|---|
| VRAM | 24 GB | 32 GB |
| Sourced runs on the board | 2 | 5 |
| Models measured | 1 | 3 |
| Best output tok/s | 141.2 tok/s | 96.1 tok/s |
| Highest measured peak VRAM | — | 25.2 GB |
| Street price (latest snapshot) | — | — |
Head-to-head
Only one model has been measured on both cards (Qwen3.8-27B). On that single data point RTX 4090 records 141.2 tok/s and Tesla V100 x2 records 24.0 tok/s — treat it as one data point, not a ranking.