Best sourced output tok/s per model (single-stream generation) — engine and version, quantization, context and a source link on every row. Hover a value for the quant.
RTX 30809 sourced runs · best 277.8 tok/s
Tesla V100 x25 verified runs · best 96.1 tok/s
Specs and evidence
RTX 3080
Tesla V100 x2
VRAM
10 GB
32 GB
Sourced runs on the board
9
5
Models measured
9
3
Best output tok/s
277.8 tok/s
96.1 tok/s
Highest measured peak VRAM
9.7 GB
25.2 GB
Street price (latest snapshot)
—
—
Sourced rows only. Peak VRAM is recorded by the person who ran the benchmark, so it is a floor for what the card can hold, not a specification. Price snapshots.
Head-to-head
On the 2 models measured on both cards, RTX 3080 leads on 1, Tesla V100 x2 on 1. The widest gap is on Qwen3.8-27B: RTX 3080 44.4 tok/s vs Tesla V100 x2 24.0 tok/s (RTX 3080 85% faster).