RTX 3090 vs RTX 4090 D
Best verified output tok/s per model (single-stream generation). Hover a value for the quant.
RTX 309012 verified runs · best 709.5 tok/s
RTX 4090 D2 verified runs · best 70.9 tok/s
| Model | RTX 3090 | RTX 4090 D |
|---|---|---|
| LFM2.5-1.2B-Instruct-GGUF | 709.5 | — |
| Qwen3.5-0.8B-MTP-GGUF | 476.1 | — |
| NVIDIA-Nemotron-3.5-Lightning-30B-A3B-GGUF | 353.7 | — |
| LFM2.5-2.6B-GGUF | 305.6 | — |
| Qwen3.5-4B-MTP-GGUF | 240.4 | — |
| Qwen3.8-27B-EXL3-3.5bpw | 164.6 | — |
| Qwen3.5-9B-MTP-GGUF | 164.3 | — |
| Qwen3.8-27B | 152.4 | 70.9 |
| Qwen/Qwen3.8-27B | 136.8 | — |
| Qwen3.8-27B-GGUF | 81.9 | — |
| Ornstein3.6-27B-MTP-NSC-ACE-SABER-GGUF | 32.9 | — |