Qwythos-9B-v2
Qwen family · 9.0B params
1recorded run
51.1best tok/s
1verified
Fastest GPUs for this model (best tok/s)
- RTX 306051.1
All benchmarks Methodology
| GPU | Model | Quant | Backend | Ctx |
tok/s | prompt tok/s | VRAM GB | Source |
| RTX 3060 · 12 GB | Qwythos-9B-v2 | Q4_K_M | llama.cpp b10443 | 32768 | 51.1 ✓ | 1446.7 | 5.8 | src |