gemma-4-26B-A4B-it-qat
2recorded runs
254.3best tok/s
1verified
Fastest GPUs for this model (best tok/s)
- RTX 5090254.3
- RTX 3060 x295.3
| GPU | Model | Quant | Backend | Ctx | tok/s | prompt tok/s | VRAM GB | Source |
|---|---|---|---|---|---|---|---|---|
| RTX 3060 x2 · 12 GB | gemma-4-26B-A4B-it-qat | Q4_K_M | llama.cpp 13f2b28 | 512 | 95.3 ✓ | 1962.1 | 16.0 | src |
| RTX 5090 · 32 GB | gemma-4-26B-A4B-it-qat | Q4_0 | lmstudio unknown | 2048 | 254.3 … | 488.7 | — | src |