Leaderboard/models/mlx-community-qwen3-coder-30b-a3b-instruct-4bit

Qwen3-Coder-30B-A3B-Instruct-4bit

Name: Qwen3-Coder-30B-A3B-Instruct-4bit — community LLM benchmarks
Creator: llm-speed
License: https://www.apache.org/licenses/LICENSE-2.0
Keywords: Qwen3-Coder-30B-A3B-Instruct-4bit, LLM benchmark, tokens per second, decode tok/s, prefill, TTFT

1 workload result across 1 hardware configuration.

Fastest local config

112.2 decode tok/s

on M3 Ultra (60-core GPU) + 96GB unified via mlx — see full run

Local runs (1 run)

Runs from contributors' own machines via MLX, llama.cpp, vLLM, exllamav2, or ollama. Signed on the submitter's hardware.

M3 Ultra (60-core GPU) + 96GB unified

Workload	Backend	Quant	decode tok/s	prefill tok/s	TTFT	Run
chat-short	mlx@0.31.3	—	112.2tok/s	204.0tok/s	539ms	r_fpsca03u2o_

Qwen3-Coder-30B-A3B-Instruct-4bit on hardware

M3 Ultra (60-core GPU) LLM benchmarks

M3 Ultra (60-core GPU) + 96GB unifiedM3 Ultra (60-core GPU) + 96GB unified

Qwen3-Coder-30B-A3B-Instruct-4bit on hardware

M3 Ultra (60-core GPU) + 96GB unified