Leaderboard/RTX 5090/DeepSeek-Coder-V2-Lite-Instruct

Can an RTX 5090 run DeepSeek-Coder-V2-Lite-Instruct?

llm-speed has not measured DeepSeek-Coder-V2-Lite-Instruct on RTX 5090 itself yet, so there is no llm-speed verdict. 2 community-submitted runs exist (fastest 309.5 tok/s at an unreported quant on llama.cpp); community-submitted, not measured by llm-speed, so they give no verdict.

2 signed runs on llm-speed. Single-request decode speed in tokens per second; the short-chat workload unless noted. All 2 runs are community-submitted (signed on the submitter's own machine, not measured by llm-speed, and not used for llm-speed verdicts). Verdicts and headline numbers use only llm-speed's own runs and fit tests.

Measured tok/s by quant and runtime

Quant	Runtime	Build	Decode tok/s (best run)	Workload	Runs	Source
not reported	llama.cpp	not reported	309.5	chat-short	2	Community-submitted

llm-speed has not measured this pair itself, so there is no llm-speed verdict or fastest quant. The rows above are community-submitted, not measured by llm-speed.

VRAM: not recorded for these runs. The VRAM calculator gives an estimate (predicted, not measured).

Every measured row

Run	Date (UTC)	Workload	Quant	Runtime / build	Prompt tokens	Output tokens	Decode tok/s	Prefill tok/s	TTFT ms	VRAM GiB	Source
r_0_gs1rgl2fl	2026-07-01	chat-short	–	llama.cpp · not reported	0	256	309.5	–	268	–	Community-submitted
r_bfpto9so2o1	2026-07-01	chat-short	–	llama.cpp · not reported	0	256	293.1	–	297	–	Community-submitted
r_bfpto9so2o1	2026-07-01	chat-long	–	llama.cpp · not reported	0	482	181.2	–	361	–	Community-submitted
r_bfpto9so2o1	2026-07-01	agent-trace	–	llama.cpp · not reported	3362	840	204.5	24978.7	81	–	Community-submitted
r_bfpto9so2o1	2026-07-01	concurrent-decode	–	llama.cpp · not reported	1024	256	268.4	–	–	–	Community-submitted

Questions