RTX 3090 x1
1recorded run
28.1best tok/s
1verified
How it compares — 24 GB per card · multi-GPU
All benchmarks Compare RTX 3090 x1 →
| GPU | Model | Quant | Backend | Ctx | tok/s | prompt tok/s | VRAM GB | Source |
|---|---|---|---|---|---|---|---|---|
| RTX 3090 x1 · 24 GB | GLM-5.3-Flash | EXL3 3.05 bpw | exllamav2 v1.5.1 | 131072 | 28.1 ✓ | — | — | src |