wrapped·Apr 28, 2026
/r/r_v4bq1sviz4oyour run
Qwen2.5-14B-Instruct-4bit
on M3 Ultra
70.9
tok/sdecode
M3 Ultra (60-core GPU) + 96GB unified
rank in tier
18/26M3 Ultra runstop 69%
best workload
chat-short
where the rig flew
slowest workload
—
single-workload run
backend
mlxMLX is the fastest backend on Apple Silicon for dense models.
faster than
- gemma-4-31B-it-Q4_K_M.gguf on RTX 509069.7 tok/s
- Qwen3-32B on RTX 509069.5 tok/s
- qwen3.6 on RTX 409044.2 tok/s