MiniCPM5-1B
2recorded runs
158.1best tok/s
1verified
Fastest GPUs for this model (best tok/s)
- RX 570 4GB x2158.1
- RTX 3060 x2125.9
| GPU | Model | Quant | Backend | Ctx | tok/s | prompt tok/s | VRAM GB | Source |
|---|---|---|---|---|---|---|---|---|
| RTX 3060 x2 · 12 GB | MiniCPM5-1B | Q4_K_M | llama.cpp 2cbfdc6 | 128000 | 125.9 ✓ | 14828.4 | 4.3 | src |
| RX 570 4GB x2 · 4 GB | MiniCPM5-1B | Q4_K_M | llama.cpp unknown | 2048 | 158.1 … | 1144.5 | — | src |