Qwen3.8-27B on RTX 5090 (32GB)
MeasuredOn 2026-11-12, Qwen3.8-27B UD-Q4_K_XL ran at 76.9 tok/s (long-context-decay) on an RTX 5090 (32GB) with llama.cpp. Run r_oifzo7k_bs2.
Workload results
| Workload | Backend | Model | decode tok/s | prefill tok/s | TTFT | p50 | p95 |
|---|---|---|---|---|---|---|---|
| long-context-decay | llama.cppbuild 12157 (fecdc81ee) | Qwen3.8-27BUD-Q4_K_XL | 76.94tok/s | 3,841.2tok/s | 3,079ms | 12.9ms | 13.2ms |
Long-context results
Qwen3.8-27B · llama.cpp. Each row is a point this run measured, keyed on the prompt tokens the runtime counted (the depth of context the prompt filled).
Prompt tokens are not the configured context capacity. “—” means unmeasured or unavailable.
Scroll the table sideways for all measurements.
| Actual prompt tokens | First token (s) | Decode tok/s | Output tokens | Status |
|---|---|---|---|---|
| 11,827 | 3.079 | 76.94 | 125 | measured |
First-token delay includes processing the prompt with the model loaded. These speed measurements do not test answer quality or the maximum usable context.
Reproduce on your machine
Start with this model and workload selection. This command does not capture the original artifact, backend version or server settings:
Match quantization, context capacity, caching and runtime settings for a useful comparison. Duration varies by workload and hardware; the published client may differ from this run's version. How it's measured.
Share this run
Copy the short link, a Reddit-ready summary, or a README badge. Every number is the measured result on this page, and each badge links back to it.
https://llm-speed.com/r/r_oifzo7k_bs2Related benchmarks
- More Qwen3.8-27B benchmarks — every backend and rig that has run this model.
- More RTX 5090 (32GB) LLM benchmarks — every model measured on this hardware.
Provenance
- Run ID
- r_oifzo7k_bs2
- Fingerprint hash
- Public key
- mE/oa8jSaLpjIWzJkKWcdzKEmZK425n37EjiITdpHrI=
- Received
- 2026-11-12 00:26:13