Best sourced output tok/s per model (single-stream generation) — engine and version, quantization, context and a source link on every row. Hover a value for the quant.
RTX 30809 sourced runs · best 277.8 tok/s
RTX 50705 verified runs · best 185.8 tok/s
Specs and evidence
RTX 3080
RTX 5070
VRAM
10 GB
12 GB
Sourced runs on the board
9
5
Models measured
9
5
Best output tok/s
277.8 tok/s
185.8 tok/s
Highest measured peak VRAM
9.7 GB
9.0 GB
Street price (latest snapshot)
—
—
Sourced rows only. Peak VRAM is recorded by the person who ran the benchmark, so it is a floor for what the card can hold, not a specification. Price snapshots.
Head-to-head
On the 2 models measured on both cards, RTX 3080 leads on 0, RTX 5070 on 2. The widest gap is on Ornith-1.5-9B: RTX 3080 82.8 tok/s vs RTX 5070 102.0 tok/s (RTX 5070 23% faster).