Instinct MI100 x4 vs RTX 4090 D

GPU AGPU B

Best verified output tok/s per model (single-stream generation). Hover a value for the quant.

Verified data on this pair is thin — most of the board is still pending review. Submit your own run and help fill the matrix: one prompt, three steps, no downloads.

Instinct MI100 x41 verified run · best 132.4 tok/s

RTX 4090 D2 verified runs · best 70.9 tok/s

Model	Instinct MI100 x4	RTX 4090 D
Qwen3.8-27B	132.4 INT8	70.9 Q4_K_M

Head-to-head (models tested on both): Instinct MI100 x4 1 · RTX 4090 D 0 · tied 0 · data as of Sep 23, 2026. Full rules: methodology.

Related reading: RTX 5090 vs 3090 · quantization · Value index · Full board