T4

Nvidia · 16 GB VRAM

1recorded run

53.3best tok/s

0sourced

How it compares — 16 GB tier

Best verified tok/s per GPU in this VRAM tier — compare any two like-for-like.

Evidence: 0 sourced runs · 1 awaiting review · 1 independent source · first recorded Aug 24, 2026. What these labels mean.

GPU	Model	Quant	Backend	Ctx	tok/s	prompt tok/s	VRAM GB	Source
T4 · 16 GB	Unsloth-Ornith-1.5-35B-A3B	Q2_K_XL	llama.cpp —	2048	53.3 …	674.1	—	src