Skip to content
llm-speed

Qwen3-32B on RTX 5090 (32GB) + AMD Ryzen 7 9850X3D 8-Core Processor (8c) + 30GB

Workload results

WorkloadBackendModeldecode tok/sprefill tok/sTTFTp50p95
chat-shortllama.cppQwen3-32B66.51tok/s—158ms14.7ms15.2ms
chat-longllama.cppQwen3-32B62.30tok/s—1,067ms16.0ms16.4ms
concurrent-decodellama.cppQwen3-32B66.64tok/s——14.9ms15.4ms
agent-tracellama.cppQwen3-32B64.34tok/s8,394.1tok/s259ms15.7ms16.1ms

Reproduce on your machine

Start with this model and workload selection. This command does not capture the original artifact, backend version or server settings:

Match quantization, context capacity, caching and runtime settings for a useful comparison. Duration varies by workload and hardware; the published client may differ from this run's version. How it's measured.

Embed this run

Drop the badge into a README, blog post, or signature. Each render is a backlink to the signed result.

llm-speed: 66.6 tok/s on RTX 5090 (32GB) (Qwen3-32B)
[![llm-speed: 66.6 tok/s on RTX 5090 (32GB) (Qwen3-32B)](https://llm-speed.com/badge/r_-txe_hiq44n.svg)](https://llm-speed.com/r/r_-txe_hiq44n)

Related benchmarks

Provenance

Run ID
r_-txe_hiq44n
Fingerprint hash
013ca61a09d17996
Public key
0tv44ISLy10gz6Oc6FJig3eWJVLwso9oKemSM4nicKM=
Received
2026-07-01 08:39:59