A100 80GB — LLM benchmarks

Name: A100 80GB — community LLM benchmarks
Creator: llm-speed
License: https://www.apache.org/licenses/LICENSE-2.0
Keywords: A100 80GB, LLM benchmark, tokens per second, decode tok/s, prefill, TTFT

No benchmarks on A100 80GB yet.

No A100 80GB benchmarks yet.

Run on YOUR hardware to populate this page: pipx install llm-speed && llm-speed bench

$ pipx install llm-speed && llm-speed bench

read the methodology

Common questions about A100 80GB

Direct Q&A drawn from the runs above: fastest LLM, supported model classes, backend rankings, quantization guidance.

Read the A100 80GB FAQ →