Skip to content
llm-speed

phi-4-4bit

7 workload results across 3 hardware configurations.

Fastest local config

140.9 decode tok/s

on RTX 5090 (32GB) + AMD Ryzen 7 9850X3D 8-Core Processor (8c) + 30GB via llama.cpp. see full run

Local runs (7 runs)

Runs from contributors' own machines via MLX, llama.cpp, vLLM, exllamav2, or ollama. Signed on the submitter's hardware.

RTX 5090 (32GB) + AMD Ryzen 7 9850X3D 8-Core Processor (8c) + 30GBRTX 5090 (32GB) + AMD Ryzen 7 9850X3D 8-Core Processor (8c) + 30GB

WorkloadBackendQuantdecode tok/sprefill tok/sTTFTRun
chat-shortllama.cpp-139.1tok/sno data51.1msr_k1u_k1j_1i2
chat-longllama.cpp-133.7tok/sno data433msr_k1u_k1j_1i2
concurrent-decodellama.cpp-140.2tok/sno datano datar_k1u_k1j_1i2
agent-tracellama.cpp-124.8tok/s21,162.4tok/s102msr_k1u_k1j_1i2
chat-shortllama.cpp-140.9tok/sno data56.7msr_e-k4aea8ipr

M3 Pro (18-core GPU) + 36GB unifiedM3 Pro (18-core GPU) + 36GB unified

WorkloadBackendQuantdecode tok/sprefill tok/sTTFTRun
chat-shortmlx@0.31.3-15.61tok/s120.7tok/s936msr_-w8hnn61va_

M3 Ultra (60-core GPU) + 96GB unifiedM3 Ultra (60-core GPU) + 96GB unified

WorkloadBackendQuantdecode tok/sprefill tok/sTTFTRun
chat-shortmlx@0.31.3-74.37tok/s255.0tok/s443msr_sqzp-0rdez-

phi-4-4bit on hardware