wrapped·Apr 28, 2026
/r/r_5r6rhiynencyour run
Qwen2.5-7B-Instruct-4bit
on M3 Ultra
140
tok/sdecode
M3 Ultra (60-core GPU) + 96GB unified
rank in tier
6/26M3 Ultra runstop 23%
best workload
chat-short
where the rig flew
slowest workload
—
single-workload run
backend
mlxMLX is the fastest backend on Apple Silicon for dense models.
faster than
- qwen2.5-coder on RTX 3090139 tok/s
- llama3.1 on RTX 3090136 tok/s
- r1 on RTX 4090134 tok/s