Skip to content
llm-speed
← raw run
wrapped·Oct 22, 2026
/r/r_dldd3d54262
your run

Muse-Glimmer-30B-ctx16k-kvq8

on RTX A4000
21.7
tok/sdecode
RTX A4000 (16GB)
rank in tier
8/18RTX A4000 runstop 44%
best workload
chat-short
where the rig flew
slowest workload
agent-trace20.0 tok/s
where the rig struggled
backend
llama.cppllama.cpp is the universal backend — broad model support, modest speed ceiling.
faster than
  • Llama-3.3-70B-Instruct on 2x RTX 309019.1 tok/s
  • llama-3.3-70b-Instruct-4bit on M3 Ultra16.8 tok/s
  • qwen2.5-72b-Instruct-4bit on M3 Ultra16.3 tok/s
share
21.7 tok/s on RTX A4000 running Muse-Glimmer-30B-ctx16k-kvq8 — top 44% of RTX A4000 runs. Signed benchmark via llm-speed.
https://llm-speed.com/wrapped/r_dldd3d54262
X / TwitterBlueskyMastodonRedditraw run

This is a shareable view of one signed llm-speed suite-suite-v1 run. Numbers are not edited. The raw record has every workload, the public key, and the fingerprint hash.