DeepSeek-Coder-V2-Lite-Instruct
1recorded run
237.3best tok/s
1verified
Fastest GPUs for this model (best tok/s)
| GPU | Model | Quant | Backend | Ctx | tok/s | prompt tok/s | VRAM GB | Source |
|---|---|---|---|---|---|---|---|---|
| RTX PRO 6000 Blackwell · 96 GB | DeepSeek-Coder-V2-Lite-Instruct | FP8 | vllm 0.26.0 | 32768 | 237.3 ✓ | — | — | src |