Skip to content
llm-speed

Qwen2.5-Coder-32B-Instruct on RTX 5090 (32GB) + AMD Ryzen 7 9850X3D 8-Core Processor (8c) + 30GB

Workload results

WorkloadBackendModeldecode tok/sprefill tok/sTTFTp50p95
chat-shortllama.cppQwen2.5-Coder-32B-Instruct67.41tok/s384ms14.8ms15.0ms
chat-longllama.cppQwen2.5-Coder-32B-Instruct69.15tok/s1,251ms14.2ms15.0ms
concurrent-decodellama.cppQwen2.5-Coder-32B-Instruct70.96tok/s14.0ms14.2ms
agent-tracellama.cppQwen2.5-Coder-32B-Instruct68.56tok/s4,677.1tok/s414ms14.2ms14.9ms

Reproduce on your machine

Same workload, same model, signed at your rig. The exact command that produced this run:

$ pipx install llm-speed && llm-speed bench --model qwen2-5-coder-32b-instruct --workload 'concurrent-decode'

Runs in about a minute. Your number lands on the leaderboard signed and linkable. How it's measured.

Embed this run

Drop the badge into a README, blog post, or signature. Each render is a backlink to the signed result.

llm-speed: 71.0 tok/s on RTX 5090 (32GB) (Qwen2.5-Coder-32B-Instruct)
[![llm-speed: 71.0 tok/s on RTX 5090 (32GB) (Qwen2.5-Coder-32B-Instruct)](https://llm-speed.com/badge/r_v983y0y3r2u.svg)](https://llm-speed.com/r/r_v983y0y3r2u)

Related benchmarks

Provenance

Run ID
r_v983y0y3r2u
Fingerprint hash
013ca61a09d17996
Public key
0tv44ISLy10gz6Oc6FJig3eWJVLwso9oKemSM4nicKM=
Received
2026-07-01 08:31:51