wrapped·Apr 28, 2026
/r/r_sx3a4y9n-m4your run
llama-3.3-70b-Instruct-4bit
on M3 Ultra
16.8
tok/sdecode
M3 Ultra (60-core GPU) + 96GB unified
rank in tier
19/20M3 Ultra runstop 95%
best workload
chat-short
where the rig flew
slowest workload
—
single-workload run
backend
mlxMLX is the fastest backend on Apple Silicon for dense models.
faster than
- phi-4-4bit on M3 Pro15.6 tok/s
- Qwen2.5-14B-Instruct-4bit on M3 Pro14.4 tok/s
- Qwen3-32B-4bit on M3 Pro7.2 tok/s