Best sourced output tok/s per model (single-stream generation) — engine and version, quantization, context and a source link on every row. Hover a value for the quant.
DGX Spark47 sourced runs · best 86.8 tok/s
Tesla V100 PCIe 16GB1 verified run · best 40.7 tok/s