Skip to content
llm-speed

qwen3.6 on RTX 4090 (48GB) + AMD EPYC 7763 64-Core Processor (128c) + 1008GB

Workload results

WorkloadBackendModeldecode tok/sprefill tok/sTTFTp50p95
chat-shortollama@0.31.1qwen3.6Q4_K_M
chat-longollama@0.31.1qwen3.6Q4_K_M
concurrent-decodeollama@0.31.1qwen3.6Q4_K_M
agent-traceollama@0.31.1qwen3.6Q4_K_M44.18tok/s1,910.5tok/s1,808ms21.1ms27.9ms

Reproduce on your machine

Same workload, same model, signed at your rig. The exact command that produced this run:

$ pipx install llm-speed && llm-speed bench --model 'qwen3.6' --workload 'agent-trace'

Runs in about a minute. Your number lands on the leaderboard signed and linkable. How it's measured.

Embed this run

Drop the badge into a README, blog post, or signature. Each render is a backlink to the signed result.

llm-speed: 44.2 tok/s on RTX 4090 (48GB) (qwen3.6)
[![llm-speed: 44.2 tok/s on RTX 4090 (48GB) (qwen3.6)](https://llm-speed.com/badge/r_h_659oy695r.svg)](https://llm-speed.com/r/r_h_659oy695r)

Related benchmarks

Provenance

Run ID
r_h_659oy695r
Fingerprint hash
Public key
pR84UZKUVvy01D+NCHFtNKy2yhEkn601cd7tj7wEUR0=
Received
2026-07-02 21:18:18