Qwen3.8-4B-Distill
1recorded run
97.1best tok/s
1verified
Fastest GPUs for this model (best tok/s)
- RTX 2060 Super97.1
| GPU | Model | Quant | Backend | Ctx | tok/s | prompt tok/s | VRAM GB | Source |
|---|---|---|---|---|---|---|---|---|
| RTX 2060 Super · 8 GB | Qwen3.8-4B-Distill | Q4_K_M | llama.cpp b10449 (0d9ceae1e38291035605613ab41a… | 8192 | 97.1 ✓ | 2145.7 | 3.0 | src |