Baichuan-M3-235B
1recorded run
26.1best tok/s
1verified
Fastest GPUs for this model (best tok/s)
- CMP 170HX x226.1
| GPU | Model | Quant | Backend | Ctx | tok/s | prompt tok/s | VRAM GB | Source |
|---|---|---|---|---|---|---|---|---|
| CMP 170HX x2 · 64 GB | Baichuan-M3-235B | Q3_K_M | llama.cpp 0.28.0 | 32768 | 26.1 ✓ | 309.3 | 118.0 | src |