RTX 3090 Ti vs Tesla V100 x2
Best sourced output tok/s per model (single-stream generation) — engine and version, quantization, context and a source link on every row. Hover a value for the quant.
Sourced data on this pair is thin — most of the board is still partial. Submit your own run and help fill the matrix: one prompt, three steps, no downloads.
RTX 3090 Ti1 sourced run · best 97.0 tok/s
Tesla V100 x25 verified runs · best 96.1 tok/s
Specs and evidence
| RTX 3090 Ti | Tesla V100 x2 | |
|---|---|---|
| VRAM | 24 GB | 32 GB |
| Sourced runs on the board | 1 | 5 |
| Models measured | 1 | 3 |
| Best output tok/s | 97.0 tok/s | 96.1 tok/s |
| Highest measured peak VRAM | 17.3 GB | 25.2 GB |
| Street price (latest snapshot) | — | — |
Head-to-head
Only one model has been measured on both cards (Qwen3.8-27B). On that single data point RTX 3090 Ti records 97.0 tok/s and Tesla V100 x2 records 24.0 tok/s — treat it as one data point, not a ranking.