Skip to content
llm-speed

llm-speed

LLM speed benchmarks: community-verified tok/s for every model + hardware combo

The benchmark suite for local + hosted LLM inference.Run it. See your tok/s. Compare your rig.

$ pipx install llm-speed && llm-speed bench

Runs in about a minute. Auto-detects your hardware and backends. Open source.

See a signed 356 tok/s run
80 signed runs3 hosts30 (model × hardware) cellsApache-2.0
Fastest local signed run356tok/sstable-code-instruct-3bon RTX 5090

Latest LLM benchmarks

20 runs · suite-v1

Explore local-LLM speed

Will it run — and how fast?Check any model + quant against your GPU or Mac, with the real measured tok/s.Buying guidesBest GPU, Mac, or rig for local LLMs — ranked on signed runs, no affiliate picks.Head-to-headRTX 5090 vs 4090, Apple vs NVIDIA, model vs model — decode tok/s side by side.Speed cheatsheetDecode tok/s for every model × hardware cell we have data for.Community reports vs signed2,176 tok/s claims from r/LocalLLaMA & HN, next to our measured numbers.FAQHow fast is usable? Does quantization cost speed? Why is long context slow?BlogLong-form on local-LLM speed, grounded in signed benchmark runs.