wrapped·Apr 28, 2026
/r/r_uoehjq0nvc0your run
Qwen2.5-Coder-7B-Instruct-4bit
on M3 Ultra
139
tok/sdecode
M3 Ultra (60-core GPU) + 96GB unified
rank in tier
5/20M3 Ultra runstop 25%
best workload
chat-short
where the rig flew
slowest workload
—
single-workload run
backend
mlxMLX is the fastest backend on Apple Silicon for dense models.
faster than
- llama-4-maverick on M3 Pro126 tok/s
- gpt-4o on M3 Pro83.8 tok/s
- Qwen3.6-27B-Q4_K_M.gguf on RTX 509069.9 tok/s