Skip to content
llm-speed
View as wrapped
Leaderboard/Nemotron-3.5-Bolt-74B-A9B-24GB/RTX 5090 (32GB)/r_z-l1yelv_67

Nemotron-3.5-Bolt-74B-A9B-24GB on RTX 5090 (32GB) + AMD EPYC 9534 64-Core Processor (128c) + 756GB

MeasuredOn 2026-10-15, Nemotron-3.5-Bolt-74B-A9B-24GB ran at 154.7 tok/s (chat-short) on an RTX 5090 (32GB) with llama.cpp. Run r_z-l1yelv_67.

RTX 5090 (32GB) + AMD EPYC 9534 64-Core Processor (128c) + 756GBRTX 5090 (32GB) + AMD EPYC 9534 64-Core Processor (128c) + 756GB
suite suite-v1
cli 0.0.7
signed2pLi/2vBo4…
Embed badgesubmitted Oct 15, 2026
https://llm-speed.com/r/r_z-l1yelv_67

Workload results

WorkloadBackendModeldecode tok/sprefill tok/sTTFTp50p95
chat-shortllama.cpp@0.7.0-dev (build 11669, commit 620d2225c)NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB154.7tok/s353.4tok/s340ms6.4ms6.5ms
chat-longllama.cpp@0.7.0-dev (build 11669, commit 620d2225c)NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB154.2tok/s2,623.3tok/s1,239ms6.4ms6.5ms
concurrent-decodellama.cpp@0.7.0-dev (build 11669, commit 620d2225c)NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB156.0tok/s——6.4ms6.5ms
agent-tracellama.cpp@0.7.0-dev (build 11669, commit 620d2225c)NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB149.3tok/s5,097.2tok/s418ms6.5ms8.5ms

Reproduce on your machine

Start with this model and workload selection. This command does not capture the original artifact, backend version or server settings:

Match quantization, context capacity, caching and runtime settings for a useful comparison. Duration varies by workload and hardware; the published client may differ from this run's version. How it's measured.

Share this run

Copy the short link, a Reddit-ready summary, or a README badge. Every number is the measured result on this page, and each badge links back to it.

llm-speed: 154.7 tok/s on RTX 5090 (32GB) (Nemotron-3.5-Bolt-74B-A9B-24GB)
https://llm-speed.com/r/r_z-l1yelv_67

Related benchmarks

Provenance

Run ID
r_z-l1yelv_67
Fingerprint hash
Public key
2pLi/2vBo4czBuzmB/3EX4tcdTLpDWVYWO7b9pbZWW0=
Received
2026-10-15 17:07:29