Hy-MT2-30B-A3B
1recorded run
61.4best tok/s
1verified
Fastest GPUs for this model (best tok/s)
- CMP 170HX x261.4
| GPU | Model | Quant | Backend | Ctx | tok/s | prompt tok/s | VRAM GB | Source |
|---|---|---|---|---|---|---|---|---|
| CMP 170HX x2 · 64 GB | Hy-MT2-30B-A3B | FP8 | vllm 0.28.0 | 32768 | 61.4 ✓ | 1957.4 | 115.5 | src |