Skip to content
llm-speed

Local vs hosted: when does buying a GPU pay off?

At low usage, hosted APIs win on $/Mtok. At high sustained usage, a 4090 or M3 Ultra wins. Here's the break-even math, run against live numbers.

Verdict

The reference local rig on the leaderboard is RTX 5090 (32GB) at 318.4tok/s. At ~$0.40 per million output tokens (typical 70B hosted price), a $2k GPU breaks even on output cost alone after roughly 5 billion output tokens generated — power and duty cycle move that number in either direction. The per-rig table below lets you re-do the arithmetic for your own usage.

Recommendation

Reference local rig on the leaderboard: RTX 5090 (32GB) at 318.4tok/s.

We don't sell hardware and we don't take affiliate commissions on hosted APIs, so the framing is just arithmetic. A consumer GPU's break-even point against a hosted endpoint depends on three things: your sustained decode tok/s, the hosted price per million output tokens, and your duty cycle. Below is a comparison table with each row anchored to a real submitted benchmark.

Submitted benchmarks

HardwareModeldecode tok/sRun
RTX 5090 (32GB)gpt-oss-20b318.4tok/sr_b9ul-vxh9sc
RTX 4090 (24GB)gemma3195.0tok/sr_dlanfbgym0h
RTX 3090 (24GB)deepseek-coder-v2189.5tok/sr_o2-1w665rtq
M3 Ultra (60-core GPU)mlx-community/DeepSeek-Coder-V2-Lite-Instruct-4bit168.3tok/sr_l_v1-zq_qaz
RTX 4090 (48GB)qwen2.5-coder161.1tok/sr_mv8n8k9wu1e
M4 Max (40-core GPU)qwen3-coder-bench-32k113.3tok/sr_roktphpc--8
M3 Pro (18-core GPU)mlx-community-Qwen2.5-7B-Instruct-4bit30.52tok/sr_llzv_g-ymaf

Side-by-side comparisons

See also: All hardware · All models · Methodology