Skip to content
llm-speed
Leaderboard/models/qwen3-0-6b

Qwen3-0.6B-4bit

4 workload results across 1 hardware configuration.

Fastest community-submitted config (not measured by llm-speed)

429.2 decode tok/s

on M3 Ultra (60-core GPU) + 96GB unified via mlx. see full run

Signed runs (4 workload results)

This run is community-submitted (signed on the submitter's own machine, not measured by llm-speed, and not used for llm-speed verdicts).

M3 Ultra (60-core GPU) + 96GB unifiedM3 Ultra (60-core GPU) + 96GB unified

WorkloadBackendQuantdecode tok/sprefill tok/sTTFTRunSource
chat-shortmlx@0.31.34BIT429.2tok/s1,185.2tok/s92.8msr_6rgao6ao735Community-submitted
chat-longmlx@0.31.34BIT334.3tok/s6,893.3tok/s457msr_6rgao6ao735Community-submitted
concurrent-decodemlx@0.31.34BIT368.7tok/sno datano datar_6rgao6ao735Community-submitted
agent-tracemlx@0.31.34BIT368.5tok/s8,617.7tok/s233msr_6rgao6ao735Community-submitted

Can Qwen3-0.6B-4bit run on your hardware?

Fastest decode speed on each GPU or Mac, from llm-speed's own runs and community-submitted runs. Each page lists every quant and runtime and labels which runs llm-speed measured.

Qwen3-0.6B-4bit on hardware

Check it for your setup

  • Predict your exact setup: estimate whether Qwen3-0.6B-4bit fits your GPU or Mac at your quant and context, next to measured speeds where we have them.
  • Request this pair: ask for a measured Qwen3-0.6B-4bit run on hardware we have not measured. Requests are ranked by votes.
  • Full run table (1 run): every Qwen3-0.6B-4bit result we have, with links to each source run.