RTX 4090 vs RTX 3090
Signed, community-submitted decode tok/s, prefill, and TTFT for RTX 4090 vs RTX 3090 — every number links to the run it came from.
Verdict
On qwen2.5-coder, the RTX 4090 leads — 161 tok/s decode versus 139 tok/s on the RTX 3090, 1.2× faster. Across 2 models measured on both, RTX 4090 is faster on 2 of 2. Every cell in the table below links to the submitted run it came from.
Models that have data on both rigs
| Model | RTX 4090 decode | RTX 3090 decode | Δ | Source runs |
|---|---|---|---|---|
| qwen2.5-coder | 161.1tok/s | 139.2tok/s | +22.0 | r_mv8n8k9wu1e · r_pb0jpnbujji |
| llama3.1 | 154.4tok/s | 136.2tok/s | +18.2 | r_h1ub_1uxzdh · r_9hurqggbshk |
See also: RTX 4090 benchmarks · RTX 3090 benchmarks · All hardware · All models · Methodology