Leaderboard/granite-8b-code-instruct-4bit/M3 Ultra (60-core GPU)/r_bue3bee0gw7

granite-8b-code-instruct-4bit on M3 Ultra (60-core GPU) + 96GB unified

Name: granite-8b-code-instruct-4bit on M3 Ultra (60-core GPU) + 96GB unified
Creator: llm-speed
License: https://www.apache.org/licenses/LICENSE-2.0
Keywords: LLM benchmark, tokens per second, granite-8b-code-instruct-4bit, M3 Ultra (60-core GPU) + 96GB unified, mlx

M3 Ultra (60-core GPU) + 96GB unified

suite suite-v1

cli 0.0.1-dev

signedG8xb3zMu3+…

submitted Apr 28, 2026

https://llm-speed.com/r/r_bue3bee0gw7

Workload results

Workload	Backend	Model	decode tok/s	prefill tok/s	TTFT	p50	p95
chat-short	mlx@0.31.3	mlx-community/granite-8b-code-instruct-4bit	112.3tok/s	525.7tok/s	221ms	8.9ms	9.0ms

Embed this run

Drop the badge into a README, blog post, or signature. Each render is a backlink to the signed result.

[![llm-speed: 112 tok/s on M3 Ultra (60-core GPU) (granite-8b-code-instruct-4bit)](https://llm-speed.com/badge/r_bue3bee0gw7.svg)](https://llm-speed.com/r/r_bue3bee0gw7)

Related benchmarks

More granite-8b-code-instruct-4bit benchmarks — every backend and rig that has run this model.
More M3 Ultra (60-core GPU) LLM benchmarks — every model measured on this hardware.

Provenance

Run ID: r_bue3bee0gw7
Fingerprint hash: bbf15132ccbbe7d7
Public key: G8xb3zMu3+pznEici/TiW0gPk5qSNIYIikGCwm1rMdQ=
Received: 2026-04-28 14:34:51