Leaderboard/qwen2.5-coder/RTX 4090 (48GB)/r_73tnfdueq2h

qwen2.5-coder on RTX 4090 (48GB) + AMD EPYC 7763 64-Core Processor (128c) + 1008GB

Name: qwen2.5-coder on RTX 4090 (48GB) + AMD EPYC 7763 64-Core Processor (128c) + 1008GB
Creator: llm-speed
License: https://creativecommons.org/licenses/by/4.0/
Keywords: LLM benchmark, tokens per second, qwen2.5-coder, RTX 4090 (48GB) + AMD EPYC 7763 64-Core Processor (128c) + 1008GB, ollama

RTX 4090 (48GB) + AMD EPYC 7763 64-Core Processor (128c) + 1008GB

suite suite-v1

cli 0.0.3

signedyKagdIwkhk…

Embed badgesubmitted Jul 02, 2026

https://llm-speed.com/r/r_73tnfdueq2h

Workload results

Workload	Backend	Model	decode tok/s	prefill tok/s	TTFT	p50	p95
chat-short	ollama@0.31.1	qwen2.5-coderQ4_K_M	89.45tok/s	466.6tok/s	281ms	11.1ms	11.3ms
chat-long	ollama@0.31.1	qwen2.5-coderQ4_K_M	83.84tok/s	3,572.3tok/s	887ms	11.9ms	12.0ms
concurrent-decode	ollama@0.31.1	qwen2.5-coderQ4_K_M	88.63tok/s	—	—	11.2ms	11.5ms
agent-trace	ollama@0.31.1	qwen2.5-coderQ4_K_M	86.21tok/s	5,298.4tok/s	395ms	11.7ms	11.9ms

Reproduce on your machine

Same workload, same model, signed at your rig. The exact command that produced this run:

$ pipx install llm-speed && llm-speed bench --model 'qwen2.5-coder' --workload 'chat-short'

Runs in about a minute. Your number lands on the leaderboard signed and linkable. How it's measured.

Embed this run

Drop the badge into a README, blog post, or signature. Each render is a backlink to the signed result.

[![llm-speed: 89.5 tok/s on RTX 4090 (48GB) (qwen2.5-coder)](https://llm-speed.com/badge/r_73tnfdueq2h.svg)](https://llm-speed.com/r/r_73tnfdueq2h)

Related benchmarks

More qwen2.5-coder benchmarks — every backend and rig that has run this model.
More RTX 4090 (48GB) LLM benchmarks — every model measured on this hardware.

Provenance

Run ID: r_73tnfdueq2h
Fingerprint hash
Public key: yKagdIwkhkk5rqJJDP9j2BL6pXv8Eb6o6dORdum0Tig=
Received: 2026-07-02 06:49:34