wrapped·Jul 01, 2026
/r/r_v983y0y3r2uyour run
Qwen2.5-Coder-32B-Instruct
on RTX 5090
67.4
tok/sdecode
RTX 5090 (32GB)
rank in tier
109/208RTX 5090 runstop 52%
best workload
chat-short
where the rig flew
slowest workload
—
single-workload run
backend
llama.cppllama.cpp is the universal backend — broad model support, modest speed ceiling.
faster than
- starcoder2-15b-4bit on M3 Ultra64.2 tok/s
- Muse-Glimmer-30B-ctx8k on RTX 409053.7 tok/s
- Codestral-22B-v0.1-4bit on M3 Ultra47.5 tok/s