Skip to content
llm-speed

Flint-40B-A2.5B-filled32k on RTX 4090 (24GB)

MeasuredOn 2026-10-29, Flint-40B-A2.5B-filled32k UD-Q3_K_XL ran at 128.9 tok/s (long-context-decay) on an RTX 4090 (24GB) with llama.cpp. Run r_jhqnznuo87u.

Model weights:View on Hugging Faceunsloth/flint-GGUFflint-UD-Q3_K_XL.gguf

RTX 4090 (24GB)RTX 4090 (24GB)
suite suite-v1
cli 0.0.9
signedKQHCPbbZMv…
Embed badge@llmspeedsubmitted Oct 29, 2026

Workload results

WorkloadBackendModeldecode tok/sprefill tok/sTTFTp50p95
long-context-decayllama.cppb11803Flint-40B-A2.5B-filled32kUD-Q3_K_XL128.9tok/s5,770.2tok/s5,675ms7.5ms9.4ms

Long-context results

Flint-40B-A2.5B-filled32k · llama.cpp. Each row is a point this run measured, keyed on the prompt tokens the runtime counted (the depth of context the prompt filled).

Prompt tokens are not the configured context capacity. “—” means unmeasured or unavailable.

Scroll the table sideways for all measurements.

Long-context measurements and status for each measured prompt length.
Actual prompt tokensFirst token (s)Decode tok/sOutput tokensStatus
32,7445.675128.94256measured

First-token delay includes processing the prompt with the model loaded. These speed measurements do not test answer quality or the maximum usable context.

Reproduce on your machine

Start with this model and workload selection. This command does not capture the original artifact, backend version or server settings:

Match quantization, context capacity, caching and runtime settings for a useful comparison. Duration varies by workload and hardware; the published client may differ from this run's version. How it's measured.

Share this run

Copy the short link, a Reddit-ready summary, or a README badge. Every number is the measured result on this page, and each badge links back to it.

llm-speed: 128.9 tok/s on RTX 4090 (24GB) (Flint-40B-A2.5B-filled32k)
https://llm-speed.com/r/r_jhqnznuo87u

Related benchmarks

Provenance

Run ID
r_jhqnznuo87u
Fingerprint hash
Public key
KQHCPbbZMviByl+uQMiCJjPfmT8WXpZPlmOIXNc7NEE=
Received
2026-10-29 13:17:59