Best sourced output tok/s per model (single-stream generation) — engine and version, quantization, context and a source link on every row. Hover a value for the quant.
RTX 3090 x28 sourced runs · best 240.8 tok/s
RTX 4090 D2 verified runs · best 70.9 tok/s
Specs and evidence
RTX 3090 x2
RTX 4090 D
VRAM
24 GB
24 GB
Sourced runs on the board
8
2
Models measured
7
1
Best output tok/s
240.8 tok/s
70.9 tok/s
Highest measured peak VRAM
42.9 GB
23.5 GB
Street price (latest snapshot)
—
—
Sourced rows only. Peak VRAM is recorded by the person who ran the benchmark, so it is a floor for what the card can hold, not a specification. Price snapshots.
Head-to-head
Only one model has been measured on both cards (Qwen3.8-27B). On that single data point RTX 3090 x2 records 219.8 tok/s and RTX 4090 D records 70.9 tok/s — treat it as one data point, not a ranking.