RTX 4090 vs RTX 3090
Signed, community-submitted decode tok/s, prefill, and TTFT for RTX 4090 vs RTX 3090 — every number links to the run it came from.
Verdict
RTX 4090 and RTX 3090 both have submitted runs, but no single model has been measured on both yet — so there is no apples-to-apples row. Each side's measured decode tok/s is listed separately below (peaks of 154 and 139 tok/s). Submit a shared workload to turn this into a direct comparison.
Models that have data on both rigs
| Model | RTX 4090 decode | RTX 3090 decode | Δ | Source runs |
|---|---|---|---|---|
| qwen2.5-coder | 161.1tok/s | 139.2tok/s | +22.0 | r_mv8n8k9wu1e · r_pb0jpnbujji |
| llama3.1 | 154.4tok/s | 136.2tok/s | +18.2 | r_h1ub_1uxzdh · r_9hurqggbshk |
See also: RTX 4090 benchmarks · RTX 3090 benchmarks · All hardware · All models · Methodology