gemma3

on RTX 4090

47.0

tok/sdecode

RTX 4090 (24GB) + AMD EPYC 7443 24-Core Processor (24c) + 252GB

rank in tier

11/12RTX 4090 runstop 92%

best workload

chat-short

where the rig flew

slowest workload

chat-long45.3 tok/s

where the rig struggled

backend

ollamaollama is llama.cpp under the hood; pure llama.cpp tends to nudge a few % faster.

faster than

Qwen2.5-32B-Instruct-4bit on M3 Ultra34.6 tok/s
Qwen2.5-Coder-32B-Instruct-4bit on M3 Ultra34.5 tok/s
Qwen3-32B-4bit on M3 Ultra34.4 tok/s

This is a shareable view of one signed llm-speed suite-suite-v1 run. Numbers are not edited. The raw record has every workload, the public key, and the fingerprint hash.