Skip to content
llm-speed

glm-4.7-flash on RTX 3090 (24GB) + AMD Ryzen Threadripper PRO 5975WX 32-Cores (32c) + 504GB

MeasuredOn 2026-10-16, glm-4.7-flash Q4_K_M ran at 134.6 tok/s (chat-short) on an RTX 3090 (24GB) with ollama. Run r_kalwcyab-86.

Workload results

WorkloadBackendModeldecode tok/sprefill tok/sTTFTp50p95
chat-shortollama@0.31.1glm-4.7-flashQ4_K_M134.6tok/s4.32tok/s24,309ms7.1ms10.1ms
chat-longollama@0.31.1glm-4.7-flashQ4_K_M116.1tok/s2,090.1tok/s1,499ms7.7ms15.4ms
concurrent-decodeollama@0.31.1glm-4.7-flashQ4_K_M133.6tok/s——7.2ms7.4ms
agent-traceollama@0.31.1glm-4.7-flashQ4_K_M125.2tok/s2,901.4tok/s614ms7.8ms10.6ms

Reproduce on your machine

Start with this model and workload selection. This command does not capture the original artifact, backend version or server settings:

Match quantization, context capacity, caching and runtime settings for a useful comparison. Duration varies by workload and hardware; the published client may differ from this run's version. How it's measured.

Share this run

Copy the short link, a Reddit-ready summary, or a README badge. Every number is the measured result on this page, and each badge links back to it.

llm-speed: 134.6 tok/s on RTX 3090 (24GB) (glm-4.7-flash)
https://llm-speed.com/r/r_kalwcyab-86

Related benchmarks

Provenance

Run ID
r_kalwcyab-86
Fingerprint hash
Public key
UmvDn3z/u86erQV5ruWFRt1IFXMixfZNc3af2xewUHU=
Received
2026-10-16 01:50:12