wrapped·Jul 02, 2026
/r/r_wjq32z47vlpyour run
qwen3-coder
on RTX 4090
180
tok/sdecode
RTX 4090 (24GB) + AMD EPYC 7352 24-Core Processor (24c) + 252GB
rank in tier
1/7RTX 4090 runstop 14%
best workload
concurrent-decode
where the rig flew
slowest workload
chat-short145 tok/s
where the rig struggled
backend
ollamaollama is llama.cpp under the hood; pure llama.cpp tends to nudge a few % faster.
faster than
- DeepSeek-Coder-V2-Lite-Instruct-4bit on M3 Ultra168 tok/s
- gemma-2-9b-it on RTX 5090153 tok/s
- gpt-oss-20b-MXFP4-Q4 on M3 Ultra153 tok/s