Ornstein3.6-27B-MTP-NSC-ACE-SABER
Qwen family · 27.0B params
1recorded run
32.9best tok/s
1verified
Fastest GPUs for this model (best tok/s)
- RTX 309032.9
All benchmarks Methodology
| GPU | Model | Quant | Backend | Ctx |
tok/s | prompt tok/s | VRAM GB | Source |
| RTX 3090 · 24 GB | Ornstein3.6-27B-MTP-NSC-ACE-SABER | Q4_K_M | llama.cpp buun-llama-cpp (86-real, MSVC 19.31,… | 262144 | 32.9 ✓ | 98.9 | 22.0 | src |