Skip to content
llm-speed

Qwen3.6-27B on RTX 3090 (24GB) + AMD EPYC 7282 16-Core Processor (16c) + 126GB

MeasuredOn 2026-10-17, Qwen3.6-27B Q4_K_M ran at 42.7 tok/s (chat-short) on an RTX 3090 (24GB) with llama.cpp. Run r_qm1xyvjmx_r.

Workload results

WorkloadBackendModeldecode tok/sprefill tok/sTTFTp50p95
chat-shortllama.cpp@0.7.0-dev (build 1, commit ea0c4c2)Qwen3.6-27BQ4_K_M42.73tok/s236.9tok/s473ms23.3ms23.4ms
chat-longllama.cpp@0.7.0-dev (build 1, commit ea0c4c2)Qwen3.6-27BQ4_K_M42.26tok/s1,321.5tok/s2,408ms23.6ms23.7ms
concurrent-decodellama.cpp@0.7.0-dev (build 1, commit ea0c4c2)Qwen3.6-27BQ4_K_M42.63tok/s——23.4ms23.4ms
agent-tracellama.cpp@0.7.0-dev (build 1, commit ea0c4c2)Qwen3.6-27BQ4_K_M42.07tok/s2,369.6tok/s881ms23.5ms23.6ms

Reproduce on your machine

Start with this model and workload selection. This command does not capture the original artifact, backend version or server settings:

Match quantization, context capacity, caching and runtime settings for a useful comparison. Duration varies by workload and hardware; the published client may differ from this run's version. How it's measured.

Share this run

Copy the short link, a Reddit-ready summary, or a README badge. Every number is the measured result on this page, and each badge links back to it.

llm-speed: 42.7 tok/s on RTX 3090 (24GB) (Qwen3.6-27B)
https://llm-speed.com/r/r_qm1xyvjmx_r

Related benchmarks

Provenance

Run ID
r_qm1xyvjmx_r
Fingerprint hash
Public key
DX6YYB9yyezZnZzra08QCYge/cRaN2B2ubC9CW+1qCM=
Received
2026-10-17 02:16:21