Qwen 3.8 Flash
8recorded runs
86.8best tok/s
8verified
Fastest GPUs for this model (best tok/s)
- DGX Spark86.8
| GPU | Model | Quant | Backend | Ctx | tok/s | prompt tok/s | VRAM GB | Source |
|---|---|---|---|---|---|---|---|---|
| DGX Spark · 128 GB | Qwen 3.8 Flash | EXL3 3.05bpw | exllamav2 523ecd3 | 2048 | 86.8 ✓ | — | — | src |
| DGX Spark · 128 GB | Qwen 3.8 Flash | EXL3 3.05bpw | exllamav2 523ecd3 | 600 | 71.7 ✓ | — | — | src |
| DGX Spark · 128 GB | Qwen 3.8 Flash | EXL3 3.05bpw | exllamav2 523ecd3 | 64000 | 67.4 ✓ | — | — | src |
| DGX Spark · 128 GB | Qwen 3.8 Flash | EXL3 3.05bpw | exllamav2 523ecd3 | 110000 | 66.0 ✓ | — | — | src |
| DGX Spark · 128 GB | Qwen 3.8 Flash | EXL3 3.05bpw | exllamav2 523ecd3 | 35000 | 58.0 ✓ | 980.0 | — | src |
| DGX Spark · 128 GB | Qwen 3.8 Flash | EXL3 3.05bpw | exllamav2 523ecd3 | 240000 | 55.8 ✓ | — | — | src |
| DGX Spark · 128 GB | Qwen 3.8 Flash | EXL3 3.05bpw | exllamav2 523ecd3 | 32000 | 55.6 ✓ | — | — | src |
| DGX Spark · 128 GB | Qwen 3.8 Flash | EXL3 3.05bpw | exllamav2 523ecd3 | 8000 | 51.5 ✓ | — | — | src |