Skip to content
llm-speed

stable-code-instruct-3b-4bit on M3 Ultra (60-core GPU) + 96GB unified

M3 Ultra (60-core GPU) + 96GB unifiedM3 Ultra (60-core GPU) + 96GB unified
suite suite-v1
cli 0.0.1-dev
signedG8xb3zMu3+…
Embed badgesubmitted Apr 28, 2026

Workload results

WorkloadBackendModeldecode tok/sprefill tok/sTTFTp50p95
chat-shortmlx@0.31.3mlx-community/stable-code-instruct-3b-4bit192.5tok/s560.7tok/s226ms5.1ms6.1ms

Reproduce on your machine

Start with this model and workload selection. This command does not capture the original artifact, backend version or server settings:

Match quantization, context capacity, caching and runtime settings for a useful comparison. Duration varies by workload and hardware; the published client may differ from this run's version. How it's measured.

Embed this run

Drop the badge into a README, blog post, or signature. Each render is a backlink to the signed result.

llm-speed: 192 tok/s on M3 Ultra (60-core GPU) (stable-code-instruct-3b-4bit)
[![llm-speed: 192 tok/s on M3 Ultra (60-core GPU) (stable-code-instruct-3b-4bit)](https://llm-speed.com/badge/r_y2_5y8oo97d.svg)](https://llm-speed.com/r/r_y2_5y8oo97d)

Related benchmarks

Provenance

Run ID
r_y2_5y8oo97d
Fingerprint hash
bbf15132ccbbe7d7
Public key
G8xb3zMu3+pznEici/TiW0gPk5qSNIYIikGCwm1rMdQ=
Received
2026-04-28 14:38:39