A100 80GB vs Gaudi 2
Specifications, today's prices from 74 providers, price per unit of memory and compute, and who rents each cheapest. Better values are highlighted; lower is better for prices.
Specs, prices, value
Highlighted cells are the better of the two: more memory and compute, lower prices, lower cost per unit.
| A100 80GB | Gaudi 2 | Difference | |
|---|---|---|---|
| Memory & compute | |||
| VRAM | 80 GB | 96 GB | -17% |
| Memory bandwidth | 2.04 TB/s | 2.45 TB/s | -17% |
| FP16 tensor | 312 TFLOPS | — | — |
| FP32 | 19.5 TFLOPS | — | — |
| Power | 400 W | 600 W | -33% |
| Prices today | |||
| Cheapest on-demand | $0.64 | $1.04 | -39% |
| Median on-demand | $1.96 | $1.18 | +66% |
| Highest on-demand | $5.25 | $1.32 | +297% |
| Cheapest spot | $0.57 | — | — |
| Cheapest reserved | $0.76 | $0.51 | +48% |
| Current offers (n) | 178 | 7 | +2443% |
| Providers with a fresh offer | 70 | 4 | +1650% |
| Value | |||
| Per GB of VRAM · hour (cheapest) | $0.008 | $0.011 | -26% |
| Per GB of VRAM · hour (median) | $0.025 | $0.012 | +99% |
| Per PFLOP FP16 · hour (median) | $6.292 | — | — |
| Per TB/s · hour (median) | $0.963 | $0.483 | +99% |
| Trend | |||
| 30-day median change | -3.5% | +9.2% | — |
| 90-day median change | -3.5% | +9.2% | — |
How the two have moved
Both medians indexed to 100 ninety days ago, so the slopes compare even though the price levels differ.
Cheapest providers today · on-demand · current offersWho rents each one cheapest
- 1
AtmosCompute1× $0.64 - 2
LeaderGPUTrust 598× $0.76 - 3
Vast.aiTrust 784× $0.84
- 1
Cyfuture AI8× $1.04 - 2
io.netTrust 428× $1.16 - 3
Sesterce CloudTrust 608× $1.21
Choose one, choose the other
Choose the A100 80GB if…
- you want choice: 70 providers have a fresh offer today against 4.
Choose the Gaudi 2 if…
- your model needs more than 80 GB per GPU: 96 GB against 80 GB.
- the hourly price matters most: median $1.18 against $1.96, 40% less.
- you serve LLMs: memory bandwidth per dollar is better ($0.483 per TB/s-hour against $0.963).
Questions about A100 80GB vs Gaudi 2
Which is cheaper to rent, the A100 80GB or the Gaudi 2?
Today the cheapest current on-demand A100 80GB is $0.64 per GPU-hour and the cheapest Gaudi 2 is $1.04; medians are $1.96 and $1.18. Cheapest excludes offers marked unavailable and counts one floor per marketplace.
How much memory do the A100 80GB and Gaudi 2 have?
80 GB of HBM2e on the A100 80GB, 96 GB of HBM2E on the Gaudi 2, at 2.04 and 2.45 TB/s.
Where do these numbers come from?
From 185 current offers read on the providers' own pages and APIs over the last 45 days (reference 00:18 UTC), or in our October 2026 market study for the few providers our collector does not read. Specifications come from manufacturer datasheets. Every price on the GPU pages links to its receipt and shows its read date.
