Leaderboard/Qwen3-8B-4bit/M3 Ultra (60-core GPU)/r_b1awwhkoo2v

Qwen3-8B-4bit on M3 Ultra (60-core GPU) + 96GB unified

Name: Qwen3-8B-4bit on M3 Ultra (60-core GPU) + 96GB unified
Creator: llm-speed
License: https://creativecommons.org/licenses/by/4.0/
Keywords: LLM benchmark, tokens per second, Qwen3-8B-4bit, M3 Ultra (60-core GPU) + 96GB unified, mlx

M3 Ultra (60-core GPU) + 96GB unified

suite suite-v1

cli 0.0.3

signedG8xb3zMu3+…

Embed badgesubmitted Jul 12, 2026

https://llm-speed.com/r/r_b1awwhkoo2v

Workload results

Workload	Backend	Model	decode tok/s	prefill tok/s	TTFT	p50	p95
chat-short	mlx@0.31.3	mlx-community/Qwen3-8B-4bit	120.5tok/s	446.1tok/s	247ms	8.3ms	8.4ms
chat-long	mlx@0.31.3	mlx-community/Qwen3-8B-4bit	103.3tok/s	1,108.8tok/s	2,838ms	9.7ms	9.9ms
concurrent-decode	mlx@0.31.3	mlx-community/Qwen3-8B-4bit	114.3tok/s	—	—	8.7ms	8.9ms
agent-trace	mlx@0.31.3	mlx-community/Qwen3-8B-4bit	109.4tok/s	1,109.1tok/s	1,885ms	9.1ms	9.7ms

Reproduce on your machine

Same workload, same model, signed at your rig. The exact command that produced this run:

$ pipx install llm-speed && llm-speed bench --model 'mlx-community/Qwen3-8B-4bit' --workload 'chat-short'

Runs in about a minute. Your number lands on the leaderboard signed and linkable. How it's measured.

Embed this run

Drop the badge into a README, blog post, or signature. Each render is a backlink to the signed result.

[![llm-speed: 120 tok/s on M3 Ultra (60-core GPU) (Qwen3-8B-4bit)](https://llm-speed.com/badge/r_b1awwhkoo2v.svg)](https://llm-speed.com/r/r_b1awwhkoo2v)

Related benchmarks

More Qwen3-8B-4bit benchmarks — every backend and rig that has run this model.
More M3 Ultra (60-core GPU) LLM benchmarks — every model measured on this hardware.

Provenance

Run ID: r_b1awwhkoo2v
Fingerprint hash: bbf15132ccbbe7d7
Public key: G8xb3zMu3+pznEici/TiW0gPk5qSNIYIikGCwm1rMdQ=
Received: 2026-07-12 10:10:19