Skip to content
llm-speed

Qwen3.8-27B on RTX 4090 (host reported 48GB)

MeasuredOn 2026-11-06, Qwen3.8-27B Q4_K_M ran at 42.3 tok/s (chat-short) on an RTX 4090 (host reported 48GB) with llama.cpp. Run r_9iyweld8pzq.

RTX 4090 (host reported 48GB)RTX 4090 (host-reported 48GB)
suite suite-v1
cli 0.0.18
signedyJvriFpCTY…
Embed badge@llmspeedsubmitted Nov 06, 2026

Workload results

WorkloadBackendModeldecode tok/sprefill tok/sTTFTp50p95
chat-shortllama.cppb12158Qwen3.8-27BQ4_K_M42.27tok/s430.4tok/s358ms22.7ms24.0ms
chat-longllama.cppb12158Qwen3.8-27BQ4_K_M42.99tok/s2,177.9tok/s1,480ms22.9ms23.3ms

Reproduce on your machine

Start with this model and workload selection. This command does not capture the original artifact, backend version or server settings:

Match quantization, context capacity, caching and runtime settings for a useful comparison. Duration varies by workload and hardware; the published client may differ from this run's version. How it's measured.

Share this run

Copy the short link, a Reddit-ready summary, or a README badge. Every number is the measured result on this page, and each badge links back to it.

llm-speed: 42.3 tok/s on host-reported 48GB 4090 (Qwen3.8-27B)
https://llm-speed.com/r/r_9iyweld8pzq

Related benchmarks

Provenance

Run ID
r_9iyweld8pzq
Fingerprint hash
Public key
yJvriFpCTYd22pIYNVMQydJSbN4WNfi2JJCydct5sRA=
Received
2026-11-06 15:36:18