wrapped·Oct 14, 2026
/r/r_eqnsqmgz29ayour run
Qwen2.5-Coder-14B-Instruct
on RTX 4090
89.9
tok/sdecode
RTX 4090 (24GB) + AMD EPYC 7642 48-Core Processor (48c) + 252GB
rank in tier
21/31RTX 4090 runstop 68%
best workload
chat-short
where the rig flew
slowest workload
chat-long84.2 tok/s
where the rig struggled
backend
llama.cppllama.cpp is the universal backend — broad model support, modest speed ceiling.
faster than
- gemma-2-9b-it-4bit on M3 Ultra89.5 tok/s
- qwen3.6-agent-q6k-ctx128k on M5 Max88.3 tok/s
- Nemotron-3.5-Bolt-74B-A9B-24GB on RTX 309087.8 tok/s