Skip to content
llm-speed
Leaderboard/models/qwen2-5-32b-instruct

Qwen2.5-32B-Instruct-4bit

7 workload results across 3 hardware configurations.

Fastest local config

71.9 decode tok/s

on RTX 5090 (32GB) + AMD Ryzen 7 9850X3D 8-Core Processor (8c) + 30GB via llama.cpp. see full run

Local runs (7 runs)

Runs from contributors' own machines via MLX, llama.cpp, vLLM, exllamav2, or ollama. Signed on the submitter's hardware.

RTX 5090 (32GB) + AMD Ryzen 7 9850X3D 8-Core Processor (8c) + 30GBRTX 5090 (32GB) + AMD Ryzen 7 9850X3D 8-Core Processor (8c) + 30GB

WorkloadBackendQuantdecode tok/sprefill tok/sTTFTRun
chat-shortllama.cpp-68.71tok/sno data77.0msr_bjy5a5izxjc
chat-longllama.cpp-65.36tok/sno data968msr_bjy5a5izxjc
concurrent-decodellama.cpp-68.60tok/sno datano datar_bjy5a5izxjc
agent-tracellama.cpp-66.45tok/s10,407.9tok/s214msr_bjy5a5izxjc
chat-shortllama.cpp-71.90tok/sno data115msr_twfs86tf_xf

M3 Pro (18-core GPU) + 36GB unifiedM3 Pro (18-core GPU) + 36GB unified

WorkloadBackendQuantdecode tok/sprefill tok/sTTFTRun
chat-shortmlx@0.31.3-7.05tok/s33.41tok/s3,921msr_f4x3xaan2ay

M3 Ultra (60-core GPU) + 96GB unifiedM3 Ultra (60-core GPU) + 96GB unified

WorkloadBackendQuantdecode tok/sprefill tok/sTTFTRun
chat-shortmlx@0.31.34bit34.60tok/s141.9tok/s923msr_njgxtgyym1e

Qwen2.5-32B-Instruct-4bit on hardware