Skip to content
llm-speed

hf.co/unsloth/Qwen3.8-27B-GGUF on RTX 3090 (24GB)

Community-submittedOn 2026-11-04, hf.co/unsloth/Qwen3.8-27B-GGUF Q4_K_M ran at 41.4 tok/s (chat-short) on an RTX 3090 (24GB) with ollama. Run r_sf9x2u7872j.

RTX 3090 (24GB)RTX 3090 (24GB)
suite suite-v1
cli 0.0.14
signedl9XI/gYNqD…
Embed badge@zeroday(unverified)submitted Nov 04, 2026

Workload results

WorkloadBackendModeldecode tok/sprefill tok/sTTFTp50p95
chat-shortollama0.40.14hf.co/unsloth/Qwen3.8-27B-GGUFQ4_K_M41.37tok/s174.5tok/s882ms23.8ms24.3ms
chat-longollama0.40.14hf.co/unsloth/Qwen3.8-27B-GGUFQ4_K_M40.96tok/s1,137.8tok/s2,833ms24.2ms24.7ms
concurrent-decodeollama0.40.14hf.co/unsloth/Qwen3.8-27B-GGUFQ4_K_M40.97tok/s——24.0ms24.4ms
agent-traceollama0.40.14hf.co/unsloth/Qwen3.8-27B-GGUFQ4_K_M39.22tok/s2,292.5tok/s904ms24.3ms27.3ms

Reproduce on your machine

Start with this model and workload selection. This command does not capture the original artifact, backend version or server settings:

Match quantization, context capacity, caching and runtime settings for a useful comparison. Duration varies by workload and hardware; the published client may differ from this run's version. How it's measured.

Share this run

Copy the short link, a Reddit-ready summary, or a README badge. Every number is the measured result on this page, and each badge links back to it.

llm-speed: 41.4 tok/s on RTX 3090 (24GB) (hf.co/unsloth/Qwen3.8-27B-GGUF)
https://llm-speed.com/r/r_sf9x2u7872j

Related benchmarks

Provenance

Run ID
r_sf9x2u7872j
Fingerprint hash
3730edd0eb2403ad
Public key
l9XI/gYNqDXT0dZ8Cm9RtnWiB6An42w+cCQ01wrFKT4=
Received
2026-11-04 14:20:02