Skip to content
llm-speed
Leaderboard/RTX 5090/Qwen3-Coder-30B-A3B-Instruct

Can an RTX 5090 run Qwen3-Coder-30B-A3B-Instruct?

Yes: an RTX 5090 runs Qwen3-Coder 30B-A3B at 304.9 tok/s at Q4_K_M, measured on llama.cpp with a 110-token prompt in October 2026.

2 signed runs on llm-speed. Single-request decode speed in tokens per second; the short-chat workload unless noted. 1 of 2 runs were measured by llm-speed (@llmspeed); the other one is community-submitted (signed on the submitter's own machine, not measured by llm-speed, and not used for llm-speed verdicts). Runs measured by llm-speed are credited to @llmspeed. Verdicts and headline numbers use only llm-speed's own runs and fit tests.

Measured tok/s by quant and runtime

QuantRuntimeBuildDecode tok/s (best run)WorkloadRunsSource
Q4_K_Mllama.cppcommit 1268eda304.9chat-short1Measured by llm-speed@llmspeed
not reportedllama.cppnot reported259.9chat-short1Community-submitted

Fastest quant that fits: Q4_K_M on llama.cpp, 304.9 tok/s (measured by llm-speed; it fits because it ran on this hardware). Quants without a run are not listed.

VRAM: not recorded for these runs. The VRAM calculator gives an estimate (predicted, not measured).

Every measured row

RunDate (UTC)WorkloadQuantRuntime / buildPrompt tokensOutput tokensDecode tok/sPrefill tok/sTTFT msVRAM GiBSource
r_vsype4pm1ko2026-10-17chat-shortQ4_K_Mllama.cpp · commit 1268eda110256304.9514.5214–Measured by llm-speed@llmspeed
r_c7qyvvmmsv12026-07-01chat-short–llama.cpp · not reported0256259.9–218–Community-submitted
r_vsype4pm1ko2026-10-17chat-longQ4_K_Mllama.cpp · commit 1268eda3147557266.28353.2377–Measured by llm-speed@llmspeed
r_vsype4pm1ko2026-10-17agent-traceQ4_K_Mllama.cpp · commit 1268eda3247840278.823318.797–Measured by llm-speed@llmspeed
r_vsype4pm1ko2026-10-17concurrent-decodeQ4_K_Mllama.cpp · commit 1268eda1024256296.7–––Measured by llm-speed@llmspeed

Questions

Can an RTX 5090 run Qwen3-Coder-30B-A3B-Instruct?

Yes: an RTX 5090 runs Qwen3-Coder 30B-A3B at 304.9 tok/s at Q4_K_M, measured on llama.cpp with a 110-token prompt in October 2026.

How many tokens per second does Qwen3-Coder-30B-A3B-Instruct get on an RTX 5090?

Decode speed measured by llm-speed, by quantization and runtime: Q4_K_M on llama.cpp: 304.9 tok/s. Based on 1 run measured by llm-speed; single-request chat-short unless noted. 1 community-submitted run is listed on the page, labelled, and not counted here.

What is the fastest quant of Qwen3-Coder-30B-A3B-Instruct that fits on an RTX 5090?

Q4_K_M on llama.cpp was the fastest measured setting at 304.9 tok/s; it fit because it ran. Other quants are listed only where a run measured them.

How much VRAM does Qwen3-Coder-30B-A3B-Instruct use on an RTX 5090?

Memory use was not recorded for these runs. The VRAM calculator gives an estimate, not a measurement.

Sources and related pages