Comparison · GPU vs GPU · read 00:18 UTCH100 vs Gaudi 2
Specifications, today's prices from 75 providers, price per unit of memory and compute, and who rents each cheapest. Better values are highlighted; lower is better for prices.
Side by sideSpecs, prices, value
Highlighted cells are the better of the two: more memory and compute, lower prices, lower cost per unit.
| H100 | Gaudi 2 | Difference | |
|---|---|---|---|
| Memory & compute | |||
| VRAM | 80 GB | 96 GB | -17% |
| Memory bandwidth | 3.35 TB/s | 2.45 TB/s | +37% |
| FP16 tensor | 989 TFLOPS | — | — |
| FP32 | 67 TFLOPS | — | — |
| Power | 700 W | 600 W | +17% |
| Prices today | |||
| Cheapest on-demand | $1.34 | $1.04 | +28% |
| Median on-demand | $3.40 | $1.18 | +187% |
| Highest on-demand | $10.10 | $1.32 | +665% |
| Cheapest spot | $0.75 | — | — |
| Cheapest reserved | $1.08 | $0.51 | +110% |
| Current offers (n) | 173 | 7 | +2371% |
| Providers with a fresh offer | 71 | 4 | +1675% |
| Value | |||
| Per GB of VRAM · hour (cheapest) | $0.017 | $0.011 | +53% |
| Per GB of VRAM · hour (median) | $0.042 | $0.012 | +245% |
| Per PFLOP FP16 · hour (median) | $3.434 | — | — |
| Per TB/s · hour (median) | $1.014 | $0.483 | +110% |
| Trend | |||
| 30-day median change | +3.7% | +9.2% | — |
| 90-day median change | +12.0% | +9.2% | — |
90 days · median on-demand price · rebased to 100How the two have moved
Both medians indexed to 100 ninety days ago, so the slopes compare even though the price levels differ.
Cheapest providers today · on-demand · current offersWho rents each one cheapest
- 1
Vast.aiTrust 784× $1.34 - 2
GPUBankTrust 931× $1.35 - 3
GcoreTrust 801× $1.71
- 1
Cyfuture AI8× $1.04 - 2
io.netTrust 428× $1.16 - 3
Sesterce CloudTrust 608× $1.21
Verdict · computed from the numbers aboveChoose one, choose the other
Choose the H100 if…
- you want choice: 71 providers have a fresh offer today against 4.
Choose the Gaudi 2 if…
- your model needs more than 80 GB per GPU: 96 GB against 80 GB.
- the hourly price matters most: median $1.18 against $3.40, 65% less.
- you serve LLMs: memory bandwidth per dollar is better ($0.483 per TB/s-hour against $1.014).
Questions about H100 vs Gaudi 2
Which is cheaper to rent, the H100 or the Gaudi 2?
Today the cheapest current on-demand H100 is $1.34 per GPU-hour and the cheapest Gaudi 2 is $1.04; medians are $3.40 and $1.18. Cheapest excludes offers marked unavailable and counts one floor per marketplace.
How much memory do the H100 and Gaudi 2 have?
80 GB of HBM3 on the H100, 96 GB of HBM2E on the Gaudi 2, at 3.35 and 2.45 TB/s.
Where do these numbers come from?
From 180 current offers read on the providers' own pages and APIs over the last 45 days (reference 00:18 UTC), or in our October 2026 market study for the few providers our collector does not read. Specifications come from manufacturer datasheets. Every price on the GPU pages links to its receipt and shows its read date.