Best sourced output tok/s per model (single-stream generation) — engine and version, quantization, context and a source link on every row. Hover a value for the quant.
DGX Spark x49 sourced runs · best 124.0 tok/s
Mac Studio M3 Ultra1 verified run · best 78.0 tok/s