wrapped·Apr 26, 2026
/r/r_bftqtkilvoeyour run
Qwen2.5-0.5B-Instruct-4bit
on M3 Pro
283
tok/sdecode
M3 Pro (18-core GPU) + 36GB unified
rank in tier
3/27M3 Pro runstop 11%
best workload
chat-short
where the rig flew
slowest workload
—
single-workload run
backend
mlxMLX is the fastest backend on Apple Silicon for dense models.
faster than
- stable-code-instruct-3b-4bit on M3 Ultra192 tok/s
- DeepSeek-Coder-V2-Lite-Instruct-4bit on M3 Ultra168 tok/s
- gpt-oss-20b-MXFP4-Q4 on M3 Ultra153 tok/s