Skip to content
llm-speed

Qwen3.8-27B on RTX 5090 (32GB)

MeasuredOn 2026-11-12, Qwen3.8-27B Q4_K_M ran at 18.6 tok/s (concurrent-decode) on an RTX 5090 (32GB) with llama.cpp. Run r_7nl1vae_gek.

RTX 5090 (32GB)RTX 5090 (32GB)
suite suite-v1
cli 0.0.23
signedEJ/v/ckbDv…
Embed badge@llmspeedsubmitted Nov 12, 2026

Workload results

WorkloadBackendModeldecode tok/sprefill tok/sTTFTp50p95
concurrent-decodellama.cppb12158Qwen3.8-27BQ4_K_M18.64tok/s——27.2ms608ms

Reproduce on your machine

Start with this model and workload selection. This command does not capture the original artifact, backend version or server settings:

Match quantization, context capacity, caching and runtime settings for a useful comparison. Duration varies by workload and hardware; the published client may differ from this run's version. How it's measured.

Share this run

Copy the short link, a Reddit-ready summary, or a README badge. Every number is the measured result on this page, and each badge links back to it.

llm-speed: 18.6 tok/s on RTX 5090 (32GB) (Qwen3.8-27B)
https://llm-speed.com/r/r_7nl1vae_gek

Related benchmarks

Provenance

Run ID
r_7nl1vae_gek
Fingerprint hash
Public key
EJ/v/ckbDvMwxZP/HJWHBPUwo0Q2Zj4wPEGXOaDD288=
Received
2026-11-12 06:31:16