A100 40GB LLM benchmark
No signed A100 40GB submissions yet. Check the configuration guidance below, or contribute a reproducible measurement from your own machine.
Specs vendor specs, not measured
- VRAM
- 40 GB
Plan memory before choosing a model
The catalog lists 40 GB of VRAM for this hardware entry. Check the capacity of your actual card. Model weights, context cache and runtime overhead must share the available memory. Capacity alone does not establish which model will fit or how fast it will run. Use the memory-fit calculator for your model and context as an estimate, then verify with the intended runtime. No signed A100 40GB measurement is available yet.
Contribute a signed A100 40GB benchmark
Run on YOUR hardware to populate this page: pipx install llm-speed && llm-speed bench
$ pipx install llm-speed && llm-speed bench
Request a run on A100 40GB
No measured run yet for these pairs. Vote for the one you want; the most-requested runs go first. See all requests.
We never sell or share your email. Privacy