wrapped·Oct 22, 2026
/r/r_wap61ewkpzmyour run
Flint-40B-A2.5B-UD-cpumoe6-ctx8k
on RTX 4090
39.8
tok/sdecode
RTX 4090 (24GB) + AMD EPYC 7452 32-Core Processor (32c) + 504GB
rank in tier
62/63RTX 4090 runstop 98%
best workload
chat-short
where the rig flew
slowest workload
—
single-workload run
backend
llama.cppllama.cpp is the universal backend — broad model support, modest speed ceiling.
faster than
- Qwen3.8-27B-ctx8k on RTX 309038.8 tok/s
- Qwen3-32B on RTX 309038.5 tok/s
- Qwen2.5-32B-Instruct-4bit on M3 Ultra34.6 tok/s