M2 Ultra LLM benchmark
No M2 Ultra LLM benchmarks yet. Be the first to submit a signed, reproducible tok/s run from your own M2 Ultra.
Will it run local LLMs?
No signed M2 Ultra run yet, but its 192GB of unified memory tells you what fits. At 4-bit it comfortably runs models up to about 172B parameters with room for context, and up to roughly 272B with tighter quantization. Check a specific model with the VRAM-fit tool.
For measured decode speed on the nearest hardware we have benchmarked: M3 Ultra · M4 Max · M3 Pro. Run the suite on your M2 Ultra to fill this page in.
No M2 Ultra benchmarks yet.
Run on YOUR hardware to populate this page: pipx install llm-speed && llm-speed bench
$ pipx install llm-speed && llm-speed bench
Common questions about M2 Ultra
Direct Q&A drawn from the runs above: fastest LLM, supported model classes, backend rankings, quantization guidance.