Gaudi 3 LLM benchmark
No signed Gaudi 3 submissions yet. Check the configuration guidance below, or contribute a reproducible measurement from your own machine.
Specs vendor specs, not measured
- VRAM
- 128 GB
Plan memory before choosing a model
The catalog lists 128 GB of VRAM for this hardware entry. Check the capacity of your actual card. Model weights, context cache and runtime overhead must share the available memory. Capacity alone does not establish which model will fit or how fast it will run. Use the memory-fit calculator for your model and context as an estimate, then verify with the intended runtime. No signed Gaudi 3 measurement is available yet.
Contribute a signed Gaudi 3 benchmark
Run on YOUR hardware to populate this page: pipx install llm-speed && llm-speed bench
$ pipx install llm-speed && llm-speed bench
Request a run on Gaudi 3
No measured run yet for these pairs. Vote for the one you want; the most-requested runs go first. See all requests.
We never sell or share your email. Privacy