Leaderboard/Qwen3.8-27B-filled32k/RTX 4090 (24GB)/r_x0ugw32ix4y

Qwen3.8-27B-filled32k on RTX 4090 (24GB)

Name: Qwen3.8-27B-filled32k on RTX 4090 (24GB)
Creator: llm-speed
License: https://creativecommons.org/licenses/by/4.0/
Keywords: LLM benchmark, tokens per second, Qwen3.8-27B-filled32k, RTX 4090 (24GB), llama.cpp

MeasuredOn 2026-10-29, Qwen3.8-27B-filled32k Q4_K_M ran at 39.0 tok/s (long-context-decay) on an RTX 4090 (24GB) with llama.cpp. Run r_x0ugw32ix4y.

Model weights:View on Hugging Faceggml-org/Qwen3.8-27B-GGUFQwen3.8-27B-Q4_K_M.gguf

RTX 4090 (24GB)

suite suite-v1

cli 0.0.9

signedFmrzRKjBU4…

Embed badge@llmspeedsubmitted Oct 29, 2026

https://llm-speed.com/r/r_x0ugw32ix4y

Workload results

Workload	Backend	Model	decode tok/s	prefill tok/s	TTFT	p50	p95
long-context-decay	llama.cpp@0.7.0-dev (build 11803, commit a37cc4610)	Qwen3.8-27B-filled32kQ4_K_M	39.00tok/s	2,859.0tok/s	11,589ms	25.4ms	27.5ms

Long-context results

Qwen3.8-27B-filled32k · llama.cpp. Each row is a point this run measured, keyed on the prompt tokens the runtime counted (the depth of context the prompt filled).

Prompt tokens are not the configured context capacity. “—” means unmeasured or unavailable.

Scroll the table sideways for all measurements.

Long-context measurements and status for each measured prompt length.
Actual prompt tokens	First token (s)	Decode tok/s	Output tokens	Status
33,133	11.589	39.00	256	measured

First-token delay includes processing the prompt with the model loaded. These speed measurements do not test answer quality or the maximum usable context.

Reproduce on your machine

Start with this model and workload selection. This command does not capture the original artifact, backend version or server settings:

Match quantization, context capacity, caching and runtime settings for a useful comparison. Duration varies by workload and hardware; the published client may differ from this run's version. How it's measured.

Share this run

Copy the short link, a Reddit-ready summary, or a README badge. Every number is the measured result on this page, and each badge links back to it.

https://llm-speed.com/r/r_x0ugw32ix4y

Related benchmarks

More Qwen3.8-27B-filled32k benchmarks — every backend and rig that has run this model.
More RTX 4090 (24GB) LLM benchmarks — every model measured on this hardware.

Provenance

Run ID: r_x0ugw32ix4y
Fingerprint hash
Public key: FmrzRKjBU4HvHFzfo2XgGWlPYIqTKxUI7sjdcUYqzW8=
Received: 2026-10-29 13:19:43