RTX 3090 vs Tesla V100 x4

Name: RTX 3090 vs Tesla V100 x4
Creator: DiggTop

GPU AGPU B

Best verified output tok/s per model (single-stream generation). Hover a value for the quant.

RTX 309012 verified runs · best 709.5 tok/s

Tesla V100 x41 verified run · best 391.0 tok/s

Model	RTX 3090	Tesla V100 x4
LFM2.5-1.2B-Instruct-GGUF	709.5 Q4_K_M	—
Qwen3.5-0.8B-MTP-GGUF	476.1 Q6_K_XL	—
Qwen3.8-27B	152.4 EXL3 4.00bpw	391.0 NVFP4
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-GGUF	353.7 NVFP4	—
LFM2.5-2.6B-GGUF	305.6 Q4_K_M	—
Qwen3.5-4B-MTP-GGUF	240.4 Q6_K_XL	—
Qwen3.8-27B-EXL3-3.5bpw	164.6 EXL3-3.5bpw	—
Qwen3.5-9B-MTP-GGUF	164.3 Q6_K_XL	—
Qwen/Qwen3.8-27B	136.8 AWQ-INT4 W4A16	—
Qwen3.8-27B-GGUF	81.9 Q4_K_XL	—
Ornstein3.6-27B-MTP-NSC-ACE-SABER-GGUF	32.9 Q4_K_M	—

Head-to-head (models tested on both): RTX 3090 0 · Tesla V100 x4 1 · tied 0 · data as of Sep 16, 2026. Full rules: methodology.