Skip to content
llm-speed

llama3.1 on RTX 4090 (host reported 48GB)

Community-submittedOn 2026-07-02, llama3.1 Q4_K_M ran at 154.4 tok/s (chat-short) on an RTX 4090 (host reported 48GB) with ollama. Run r_h1ub_1uxzdh.

RTX 4090 (host reported 48GB)RTX 4090 (host-reported 48GB)
suite suite-v1
cli 0.0.3
signedRh0oI3MkU2…
Embed badgesubmitted Jul 02, 2026

Workload results

WorkloadBackendModeldecode tok/sprefill tok/sTTFTp50p95
chat-shortollama0.31.1llama3.1Q4_K_M154.4tok/s328.0tok/s335ms6.5ms6.6ms
chat-longollama0.31.1llama3.1Q4_K_M146.3tok/s5,032.5tok/s623ms6.8ms6.9ms
concurrent-decodeollama0.31.1llama3.1Q4_K_M154.2tok/s——6.5ms6.5ms
agent-traceollama0.31.1llama3.1Q4_K_M149.4tok/s5,377.5tok/s387ms6.6ms6.9ms

Reproduce on your machine

Start with this model and workload selection. This command does not capture the original artifact, backend version or server settings:

Match quantization, context capacity, caching and runtime settings for a useful comparison. Duration varies by workload and hardware; the published client may differ from this run's version. How it's measured.

Share this run

Copy the short link, a Reddit-ready summary, or a README badge. Every number is the measured result on this page, and each badge links back to it.

llm-speed: 154.4 tok/s on host-reported 48GB 4090 (llama3.1)
https://llm-speed.com/r/r_h1ub_1uxzdh

Related benchmarks

Provenance

Run ID
r_h1ub_1uxzdh
Fingerprint hash
Public key
Rh0oI3MkU2qQjlZNTW9OWkLkQFfciipMknIuJzj+LZY=
Received
2026-07-02 06:47:15