Skip to content
llm-speed

stable-code-instruct-3b on RTX 5090 (32GB) + AMD Ryzen 7 9850X3D 8-Core Processor (8c) + 30GB

Workload results

WorkloadBackendModeldecode tok/sprefill tok/sTTFTp50p95
chat-shortllama.cppstable-code-instruct-3b341.9tok/s175ms2.9ms3.1ms
chat-longllama.cppstable-code-instruct-3b289.1tok/s232ms3.4ms3.5ms
concurrent-decodellama.cppstable-code-instruct-3b356.1tok/s2.7ms2.8ms
agent-tracellama.cppstable-code-instruct-3b292.8tok/s44,387.5tok/s42.7ms3.4ms4.1ms

Reproduce on your machine

Same workload, same model, signed at your rig. The exact command that produced this run:

$ pipx install llm-speed && llm-speed bench --model 'stable-code-instruct-3b' --workload 'concurrent-decode'

Runs in about a minute. Your number lands on the leaderboard signed and linkable. How it's measured.

Embed this run

Drop the badge into a README, blog post, or signature. Each render is a backlink to the signed result.

llm-speed: 356 tok/s on RTX 5090 (32GB) (stable-code-instruct-3b)
[![llm-speed: 356 tok/s on RTX 5090 (32GB) (stable-code-instruct-3b)](https://llm-speed.com/badge/r_q9f15lz6831.svg)](https://llm-speed.com/r/r_q9f15lz6831)

Related benchmarks

Provenance

Run ID
r_q9f15lz6831
Fingerprint hash
013ca61a09d17996
Public key
0tv44ISLy10gz6Oc6FJig3eWJVLwso9oKemSM4nicKM=
Received
2026-07-01 08:49:35