Leaderboard/gemma-2-9b-it-4bit/M3 Pro (18-core GPU)/r_q7t7b7dcuz5

gemma-2-9b-it-4bit on M3 Pro (18-core GPU) + 36GB unified

Name: gemma-2-9b-it-4bit on M3 Pro (18-core GPU) + 36GB unified
Creator: llm-speed
License: https://www.apache.org/licenses/LICENSE-2.0
Keywords: LLM benchmark, tokens per second, gemma-2-9b-it-4bit, M3 Pro (18-core GPU) + 36GB unified, mlx

M3 Pro (18-core GPU) + 36GB unified

suite suite-v1

cli 0.0.1-dev

signedS8711zXnps…

submitted Apr 28, 2026

https://llm-speed.com/r/r_q7t7b7dcuz5

Workload results

Workload	Backend	Model	decode tok/s	prefill tok/s	TTFT	p50	p95
chat-short	mlx@0.31.3	mlx-community/gemma-2-9b-it-4bit	21.97tok/s	102.5tok/s	1,151ms	44.5ms	54.3ms

Embed this run

Drop the badge into a README, blog post, or signature. Each render is a backlink to the signed result.

[![llm-speed: 22.0 tok/s on M3 Pro (18-core GPU) (gemma-2-9b-it-4bit)](https://llm-speed.com/badge/r_q7t7b7dcuz5.svg)](https://llm-speed.com/r/r_q7t7b7dcuz5)

Related benchmarks

More gemma-2-9b-it-4bit benchmarks — every backend and rig that has run this model.
More M3 Pro (18-core GPU) LLM benchmarks — every model measured on this hardware.

Provenance

Run ID: r_q7t7b7dcuz5
Fingerprint hash: a52e5dd258afe436
Public key: S8711zXnpsbOS9F8EZCne0DE3jWiyeYAqEDECBzTVWk=
Received: 2026-04-28 15:00:38