Skip to content
llm-speed

Can an RTX 5880 Ada run Llama 3.2 1B?

The answer

llm-speed has not measured Llama 3.2 1B on RTX 5880 Ada itself yet, so there is no llm-speed verdict. 1 community-submitted run exists (fastest 466.9 tok/s at Q8_0 on ollama); community-submitted, not measured by llm-speed, so it gives no verdict.

1 signed run on llm-speed. Single-request decode speed in tokens per second; the short-chat workload unless noted. This run is community-submitted (signed on the submitter's own machine, not measured by llm-speed, and not used for llm-speed verdicts). Verdicts and headline numbers use only llm-speed's own runs and fit tests.

Measured tok/s by quant and runtime

QuantRuntimeBuildDecode tok/s (best run)WorkloadRunsSource
Q8_0ollama0.34.2466.9chat-short1Community-submitted

llm-speed has not measured this pair itself, so there is no llm-speed verdict or fastest quant. The rows above are community-submitted, not measured by llm-speed.

Check whether a model fits your GPU with the VRAM calculator.

Every measured row

RunDate (UTC)WorkloadQuantRuntime / buildPrompt tokensOutput tokensDecode tok/sPrefill tok/sTTFT msVRAM GiBSource
r_b948ehgi8g42026-09-19chat-shortQ8_0ollama0.34.2125256466.944.32821–Community-submitted
r_b948ehgi8g42026-09-19chat-longQ8_0ollama0.34.23152273441.939673.079–Community-submitted
r_b948ehgi8g42026-09-19agent-traceQ8_0ollama0.34.23225840452.391077.222–Community-submitted
r_b948ehgi8g42026-09-19concurrent-decodeQ8_0ollama0.34.21024256464.2–––Community-submitted

Questions

Can an RTX 5880 Ada run Llama 3.2 1B?

llm-speed has not measured Llama 3.2 1B on RTX 5880 Ada itself yet, so there is no llm-speed verdict. 1 community-submitted run exists (fastest 466.9 tok/s at Q8_0 on ollama); community-submitted, not measured by llm-speed, so it gives no verdict.

What did community runs measure for Llama 3.2 1B on an RTX 5880 Ada?

1 community-submitted run (community-submitted, not measured by llm-speed): Q8_0 on ollama: 466.9 tok/s. They are listed for reference and give no llm-speed verdict.

Sources and related pages