Can an M3 Ultra run Codestral-22B-v0.1?
The answer
llm-speed has not measured Codestral-22B-v0.1 on M3 Ultra itself yet, so there is no llm-speed verdict. 1 community-submitted run exists (fastest 47.5 tok/s at 4-bit on mlx); community-submitted, not measured by llm-speed, so it gives no verdict.
1 signed run on llm-speed. Single-request decode speed in tokens per second; the short-chat workload unless noted. This run is community-submitted (signed on the submitter's own machine, not measured by llm-speed, and not used for llm-speed verdicts). Verdicts and headline numbers use only llm-speed's own runs and fit tests.
Measured tok/s by quant and runtime
| Quant | Runtime | Build | Decode tok/s (best run) | Workload | Runs | Source |
|---|---|---|---|---|---|---|
| 4-bit | mlx | 0.31.3 | 47.5 | chat-short | 1 | Community-submitted |
llm-speed has not measured this pair itself, so there is no llm-speed verdict or fastest quant. The rows above are community-submitted, not measured by llm-speed.
VRAM: not recorded for these runs. The VRAM calculator gives an estimate (predicted, not measured).
Every measured row
| Run | Date (UTC) | Workload | Quant | Runtime / build | Prompt tokens | Output tokens | Decode tok/s | Prefill tok/s | TTFT ms | VRAM GiB | Source |
|---|---|---|---|---|---|---|---|---|---|---|---|
| r_79dvtag5fd_ | 2026-04-28 | chat-short | 4-bit | mlx · 0.31.3 | 115 | 256 | 47.5 | 205.7 | 559 | – | Community-submitted |
Questions
Can an M3 Ultra run Codestral-22B-v0.1?
llm-speed has not measured Codestral-22B-v0.1 on M3 Ultra itself yet, so there is no llm-speed verdict. 1 community-submitted run exists (fastest 47.5 tok/s at 4-bit on mlx); community-submitted, not measured by llm-speed, so it gives no verdict.
What did community runs measure for Codestral-22B-v0.1 on an M3 Ultra?
1 community-submitted run (community-submitted, not measured by llm-speed): 4-bit on mlx: 47.5 tok/s. They are listed for reference and give no llm-speed verdict.
Sources and related pages
- Source runs: r_79dvtag5fd_
- Codestral-22B-v0.1: every measured GPU and Mac
- M3 Ultra: every measured model
- VRAM calculator for Codestral-22B-v0.1 on M3 Ultra
- Qwen3-Coder-30B-A3B-Instruct vs Codestral-22B-v0.1
- Qwen2.5-Coder-32B-Instruct vs Codestral-22B-v0.1
- DeepSeek-Coder-V2-Lite-Instruct vs Codestral-22B-v0.1
- How runs are measured · open dataset (CC BY 4.0)