GLM-5.2
1recorded run
29.7best tok/s
1verified
Fastest GPUs for this model (best tok/s)
- CMP 170HX x1029.7
| GPU | Model | Quant | Backend | Ctx | tok/s | prompt tok/s | VRAM GB | Source |
|---|---|---|---|---|---|---|---|---|
| CMP 170HX x10 · 64 GB | GLM-5.2 | INT4-INT8-Mix | vllm 0.20.2 | 131072 | 29.7 ✓ | 193387.9 | — | src |