Best sourced output tok/s per model (single-stream generation) — engine and version, quantization, context and a source link on every row. Hover a value for the quant.
RTX 3090 x27 sourced runs · best 240.8 tok/s
RTX 3090 x84 verified runs · best 91.2 tok/s
Specs and evidence
RTX 3090 x2
RTX 3090 x8
VRAM
24 GB
24 GB
Sourced runs on the board
7
4
Models measured
6
3
Best output tok/s
240.8 tok/s
91.2 tok/s
Highest measured peak VRAM
42.9 GB
184.3 GB
Street price (latest snapshot)
—
—
Sourced rows only. Peak VRAM is recorded by the person who ran the benchmark, so it is a floor for what the card can hold, not a specification. Price snapshots.
9 rows · 6 models on RTX 3090 x2, 3 on RTX 3090 x8 — no verified overlap yet, each side shows its own bests · data as of Oct 17, 2026. Full rules: methodology.