R1-0528-Qwen3-8B
1 workload result across 1 hardware configuration.
Fastest config measured by llm-speed (@llmspeed)
155.0 decode tok/s
on RTX 4090 (24GB) via llama.cpp (Q4_K_M). see full run
Measured runs (1 workload result)
This run was measured by llm-speed (@llmspeed).
RTX 4090 (24GB)measured by llm-speed
| Workload | Backend | Quant | decode tok/s | prefill tok/s | TTFT | Run | Source |
|---|---|---|---|---|---|---|---|
| chat-short | llama.cpp@0.7.0-dev (build 11803, commit a37cc4610) | Q4_K_M | 155.0tok/s | 2,106.7tok/s | 49.8ms | r_ll6l5npoik8 | Measured by llm-speed@llmspeed |
Can R1-0528-Qwen3-8B run on your hardware?
Fastest decode speed on each GPU or Mac, from llm-speed's own runs and community-submitted runs. Each page lists every quant and runtime and labels which runs llm-speed measured.
- RTX 4090 · 155.0 tok/s
R1-0528-Qwen3-8B on hardware
Check it for your setup
- Predict your exact setup: estimate whether R1-0528-Qwen3-8B fits your GPU or Mac at your quant and context, next to measured speeds where we have them.
- Request this pair: ask for a measured R1-0528-Qwen3-8B run on hardware we have not measured. Requests are ranked by votes.
- Full run table (1 run): every R1-0528-Qwen3-8B result we have, with links to each source run.