RTX 4060 Ti x2

Nvidia · 16 GB VRAM

2recorded runs

44.0best tok/s

0sourced

How it compares — 16 GB per card · multi-GPU

Tesla V100 x4391.0 RTX 5060 Ti x273.1

Best verified tok/s per GPU in this VRAM tier — compare any two like-for-like.

Evidence: 0 sourced runs · 2 awaiting review · 1 independent source · first recorded Aug 16, 2026 · last recorded Aug 16, 2026. What these labels mean.

All benchmarks Compare RTX 4060 Ti x2 →

GPU	Model	Quant	Backend	Ctx	tok/s	prompt tok/s	VRAM GB	Source
RTX 4060 Ti x2 · 16 GB	Muse-Glimmer-30B	UD-Q6_K_XL	llama.cpp —	125000	44.0 …	841.2	—	src
RTX 4060 Ti x2 · 16 GB	Qwen3.8-27B	UD-Q6_K_XL	llama.cpp —	70000	43.6 …	934.5	—	src

Related reading: GPU buying guide · used GPUs · Value index · Street prices