Skip to content
llm-speed
Leaderboard/M3 Pro/Qwen2.5-7B-Instruct

Can an M3 Pro run Qwen2.5-7B-Instruct?

llm-speed has not measured Qwen2.5-7B-Instruct on M3 Pro itself yet, so there is no llm-speed verdict. 2 community-submitted runs exist (fastest 30.5 tok/s at 4-bit on mlx); community-submitted, not measured by llm-speed, so they give no verdict.

2 signed runs on llm-speed. Single-request decode speed in tokens per second; the short-chat workload unless noted. All 2 runs are community-submitted (signed on the submitter's own machine, not measured by llm-speed, and not used for llm-speed verdicts). Verdicts and headline numbers use only llm-speed's own runs and fit tests.

Measured tok/s by quant and runtime

QuantRuntimeBuildDecode tok/s (best run)WorkloadRunsSource
4-bitmlx0.31.330.5chat-short2Community-submitted

llm-speed has not measured this pair itself, so there is no llm-speed verdict or fastest quant. The rows above are community-submitted, not measured by llm-speed.

VRAM: not recorded for these runs. The VRAM calculator gives an estimate (predicted, not measured).

Every measured row

RunDate (UTC)WorkloadQuantRuntime / buildPrompt tokensOutput tokensDecode tok/sPrefill tok/sTTFT msVRAM GiBSource
r_llzv_g-ymaf2026-04-28chat-short4-bitmlx · 0.31.313125630.5161.9809–Community-submitted
r_e3t93rscswq2026-04-28chat-short4-bitmlx · 0.31.313125615.754.32411–Community-submitted

Questions

Can an M3 Pro run Qwen2.5-7B-Instruct?

llm-speed has not measured Qwen2.5-7B-Instruct on M3 Pro itself yet, so there is no llm-speed verdict. 2 community-submitted runs exist (fastest 30.5 tok/s at 4-bit on mlx); community-submitted, not measured by llm-speed, so they give no verdict.

What did community runs measure for Qwen2.5-7B-Instruct on an M3 Pro?

2 community-submitted runs (community-submitted, not measured by llm-speed): 4-bit on mlx: 30.5 tok/s. They are listed for reference and give no llm-speed verdict.

Sources and related pages