qwen2.5-coder

on RTX 4090

89.5

tok/sdecode

RTX 4090 (48GB) + AMD EPYC 7763 64-Core Processor (128c) + 1008GB

rank in tier

3/3RTX 4090 runs

best workload

chat-short

where the rig flew

slowest workload

chat-long83.8 tok/s

where the rig struggled

backend

ollamaollama is llama.cpp under the hood; pure llama.cpp tends to nudge a few % faster.

faster than

Qwen3-Next-80B-A3B-Instruct-MLX-4bit on M3 Ultra80.3 tok/s
phi-4-4bit on M3 Ultra74.4 tok/s
Qwen3.6-27B-Q4_K_M.gguf on RTX 509074.0 tok/s

This is a shareable view of one signed llm-speed suite-suite-v1 run. Numbers are not edited. The raw record has every workload, the public key, and the fingerprint hash.