Skip to content
llm-speed

gemma3 on RTX 4090 (24GB)

Community-submittedOn 2026-07-02, gemma3 Q4_K_M ran at 195.0 tok/s (chat-short) on an RTX 4090 (24GB) with ollama. Run r_dlanfbgym0h.

RTX 4090 (24GB)RTX 4090 (24GB)
suite suite-v1
cli 0.0.3
signedE+zg15JJFh…
Embed badgesubmitted Jul 02, 2026

Workload results

WorkloadBackendModeldecode tok/sprefill tok/sTTFTp50p95
chat-shortollama0.31.1gemma3Q4_K_M195.0tok/s167.2tok/s706ms5.1ms5.4ms
chat-longollama0.31.1gemma3Q4_K_M187.6tok/s3,254.1tok/s979ms5.3ms5.4ms
concurrent-decodeollama0.31.1gemma3Q4_K_M193.1tok/s——5.1ms5.3ms
agent-traceollama0.31.1gemma3Q4_K_M190.0tok/s3,543.4tok/s715ms5.2ms5.5ms

Reproduce on your machine

Start with this model and workload selection. This command does not capture the original artifact, backend version or server settings:

Match quantization, context capacity, caching and runtime settings for a useful comparison. Duration varies by workload and hardware; the published client may differ from this run's version. How it's measured.

Share this run

Copy the short link, a Reddit-ready summary, or a README badge. Every number is the measured result on this page, and each badge links back to it.

llm-speed: 195.0 tok/s on RTX 4090 (24GB) (gemma3)
https://llm-speed.com/r/r_dlanfbgym0h

Related benchmarks

Provenance

Run ID
r_dlanfbgym0h
Fingerprint hash
Public key
E+zg15JJFhXi/5idiflZ8wsx7P2xrouvCpxt67yVxfE=
Received
2026-07-02 16:53:44