Skip to content
llm-speed

Qwen3.8-27B-ctx4k on L40S (45GB)

MeasuredOn 2026-10-29, Qwen3.8-27B-ctx4k Q4_K_M ran at 34.3 tok/s (chat-short) on an L40S (45GB) with llama.cpp. Run r_kv0vxavv3x_.

Model weights:View on Hugging Faceggml-org/Qwen3.8-27B-GGUFQwen3.8-27B-Q4_K_M.gguf

L40S (45GB)L40S (45GB)
suite suite-v1
cli 0.0.9
signed7mwEA3OT5S…
Embed badge@llmspeedsubmitted Oct 29, 2026

Workload results

WorkloadBackendModeldecode tok/sprefill tok/sTTFTp50p95
chat-shortllama.cppb11803Qwen3.8-27B-ctx4kQ4_K_M34.28tok/s568.8tok/s271ms29.0ms29.5ms

Reproduce on your machine

Start with this model and workload selection. This command does not capture the original artifact, backend version or server settings:

Match quantization, context capacity, caching and runtime settings for a useful comparison. Duration varies by workload and hardware; the published client may differ from this run's version. How it's measured.

Share this run

Copy the short link, a Reddit-ready summary, or a README badge. Every number is the measured result on this page, and each badge links back to it.

llm-speed: 34.3 tok/s on L40S (45GB) (Qwen3.8-27B-ctx4k)
https://llm-speed.com/r/r_kv0vxavv3x_

Related benchmarks

Provenance

Run ID
r_kv0vxavv3x_
Fingerprint hash
Public key
7mwEA3OT5SKDIsG7LhTF3bg/XKVSqFFLy1cyIVkkaRg=
Received
2026-10-29 06:05:15