Leaderboard/model/llama-3-1-8b-instruct

llama-3-1-8b-instruct

Name: llama-3-1-8b-instruct — community LLM benchmarks
Creator: llm-speed
License: https://www.apache.org/licenses/LICENSE-2.0
Keywords: llama-3-1-8b-instruct, LLM benchmark, tokens per second, decode tok/s, prefill, TTFT

No benchmarks for llama-3-1-8b-instruct yet.

No llama-3-1-8b-instruct benchmarks yet.

Run on YOUR hardware to populate this page: pipx install llm-speed && llm-speed bench

$ pipx install llm-speed && llm-speed bench

read the methodology