wrapped·Apr 28, 2026
/r/r_q7t7b7dcuz5your run
gemma-2-9b-it-4bit
on M3 Pro
22.0
tok/sdecode
M3 Pro (18-core GPU) + 36GB unified
rank in tier
16/27M3 Pro runstop 59%
best workload
chat-short
where the rig flew
slowest workload
—
single-workload run
backend
mlxMLX is the fastest backend on Apple Silicon for dense models.
faster than
- claude-sonnet-4.5 on RTX 509021.6 tok/s
- llama-3.3-70b-Instruct-4bit on M3 Ultra16.8 tok/s
- qwen2.5-72b-Instruct-4bit on M3 Ultra16.3 tok/s