Llama-3.1-70B-Instruct vs Llama-3.3-70B-Instruct
Side-by-side decode tok/s, prefill tok/s, and TTFT for Llama-3.1-70B-Instruct and Llama-3.3-70B-Instruct, sourced from community-submitted runs of the llm-speed suite. Every number on this page links back to the run it came from.
No overlapping Llama-3.1-70B-Instruct ↔ Llama-3.3-70B-Instruct benchmarks yet.
We don't have a submitted run that covers both sides of this comparison yet. Run the suite on either side to populate this page:
$ pipx install llm-speed && llm-speed bench
See also: Llama-3.1-70B-Instruct benchmarks · Llama-3.3-70B-Instruct benchmarks · All hardware · All models · Methodology