Best sourced output tok/s per model (single-stream generation) — engine and version, quantization, context and a source link on every row. Hover a value for the quant.
DGX Spark x49 sourced runs · best 124.0 tok/s
RTX PRO 6000 Blackwell x23 verified runs · best 179.5 tok/s