Skip to content
llm-speed

Measurement wanted · request DR-027 · opened 2026-11-06

Nemotron 3.5 Bolt E4B on RTX 5090: not measured yet

We don't have a Nemotron 3.5 Bolt E4B speed run on RTX 5090 yet, so there is no tokens-per-second number here. People asked for it, and this page is where the result will appear. Anyone with that hardware can run it with the free llm-speed CLI, and we'll post it as a community run.

What's being requested

Model
Nemotron 3.5 Bolt E4B · nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-4GB
Hardware
RTX 5090
Also requested
Apple M5 Max 48GB

Runs we already have

No Nemotron 3.5 Bolt E4B runs on any hardware yet.

Run it yourself

Start llama-server with the model (flags below are a starting point; adjust offload to your machine), then point llm-speed at it. Add --llama-args='...' with the flags you used so the run records them.

pipx install llm-speed   # or: pipx upgrade llm-speed
# any recent llama.cpp release
llama-server -m /path/to/MODEL.gguf --port 8080 -ngl 999
# then, in a second terminal:
LLAMA_CPP_SERVER_URL=http://127.0.0.1:8080 \
  llm-speed bench --backend llama.cpp \
  --model /path/to/MODEL.gguf \
  --workload chat-short

The upload is signed and public. How contributing works · what the CLI sends.

Get an alert

Email alerts for this page are switching on soon. Until then, follow @llmspeed on X, where new runs are posted.

All requested runs