Instinct MI100 x4 vs Radeon AI Pro R9700
Best verified output tok/s per model (single-stream generation). Hover a value for the quant.
Instinct MI100 x41 verified run · best 132.4 tok/s
Radeon AI Pro R970013 verified runs · best 969.4 tok/s
| Model | Instinct MI100 x4 | Radeon AI Pro R9700 |
|---|---|---|
| Qwen3.6-35B-A3B | — | 969.4 |
| Qwen3.5-0.8B | — | 554.5 |
| LFM2.5-230M | — | 520.0 |
| LFM2.5-350M | — | 466.0 |
| Qwen3.5-27B | — | 286.6 |
| LFM2.5-8B-A1B | — | 241.1 |
| gemma-4-E2B-it | — | 169.7 |
| gemma-4-E4B-it | — | 137.0 |
| Muse-Glimmer-30B | — | 134.6 |
| Qwen3.8-27B | 132.4 | 64.3 |
| DeepSeek-V4-Flash-0731 | — | 59.4 |
| Qwen3.8-Flash-Next | — | 25.6 |
| GLM-5.3-Flash | — | 17.4 |