Ornith-1.0-35B
2recorded runs
309.7best tok/s
2verified
Fastest GPUs for this model (best tok/s)
- RTX PRO 6000 Blackwell309.7
- RTX 5090196.6
| GPU | Model | Quant | Backend | Ctx | tok/s | prompt tok/s | VRAM GB | Source |
|---|---|---|---|---|---|---|---|---|
| RTX PRO 6000 Blackwell · 96 GB | Ornith-1.0-35B | Q4_K_M | llama.cpp v1 (6f4f53f) | 524288 | 309.7 ✓ | 8996.0 | 72.7 | src |
| RTX 5090 · 32 GB | Ornith-1.0-35B | AWQ | vllm v0.25.1 | 65536 | 196.6 ✓ | — | — | src |