RTX 3090 x2 vs Tesla V100 x4
Best sourced output tok/s per model (single-stream generation) — engine and version, quantization, context and a source link on every row. Hover a value for the quant.
Sourced data on this pair is thin — most of the board is still partial. Submit your own run and help fill the matrix: one prompt, three steps, no downloads.
RTX 3090 x28 sourced runs · best 240.8 tok/s
Tesla V100 x41 verified run · best 391.0 tok/s
Specs and evidence
| RTX 3090 x2 | Tesla V100 x4 | |
|---|---|---|
| VRAM | 24 GB | 16 GB |
| Sourced runs on the board | 8 | 1 |
| Models measured | 7 | 1 |
| Best output tok/s | 240.8 tok/s | 391.0 tok/s |
| Highest measured peak VRAM | 42.9 GB | 61.0 GB |
| Street price (latest snapshot) | — | — |
Head-to-head
Only one model has been measured on both cards (Qwen3.8-27B). On that single data point RTX 3090 x2 records 219.8 tok/s and Tesla V100 x4 records 391.0 tok/s — treat it as one data point, not a ranking.