A100 40GB vs RTX 5090
Specifications, today's prices from 47 providers, price per unit of memory and compute, and who rents each cheapest. Better values are highlighted; lower is better for prices.
Specs, prices, value
Highlighted cells are the better of the two: more memory and compute, lower prices, lower cost per unit.
| A100 40GB | RTX 5090 | Difference | |
|---|---|---|---|
| Memory & compute | |||
| VRAM | 40 GB | 32 GB | +25% |
| Memory bandwidth | 1.55 TB/s | 1.79 TB/s | -13% |
| FP16 tensor | 312 TFLOPS | — | — |
| FP32 | 19.5 TFLOPS | 104.8 TFLOPS | -81% |
| Power | 250 W | 575 W | -57% |
| Prices today | |||
| Cheapest on-demand | $0.58 | $0.22 | +169% |
| Median on-demand | $1.83 | $0.69 | +165% |
| Highest on-demand | $4.48 | $1.88 | +138% |
| Cheapest spot | $0.68 | $0.10 | +580% |
| Cheapest reserved | $0.72 | $0.38 | +89% |
| Current offers (n) | 56 | 55 | +2% |
| Providers with a fresh offer | 22 | 25 | -12% |
| Value | |||
| Per GB of VRAM · hour (cheapest) | $0.015 | $0.007 | +116% |
| Per GB of VRAM · hour (median) | $0.046 | $0.022 | +112% |
| Per PFLOP FP16 · hour (median) | $5.865 | — | — |
| Per TB/s · hour (median) | $1.177 | $0.385 | +206% |
| Trend | |||
| 30-day median change | -4.1% | +29.7% | — |
| 90-day median change | +23.4% | — | — |
How the two have moved
Both medians indexed to 100 ninety days ago, so the slopes compare even though the price levels differ.
Cheapest providers today · on-demand · current offersWho rents each one cheapest
- 1
Edgevana1× $0.58 - 2
AtmosCompute1× $0.73 - 3
JarvisLabsTrust 491× $0.89
- 1
Clore.aiTrust 491× $0.22 - 2
SaladTrust 671× $0.24 - 3
HyperAI1× $0.35
Choose one, choose the other
Choose the A100 40GB if…
- your model needs more than 32 GB per GPU: 40 GB against 32 GB.
Choose the RTX 5090 if…
- the hourly price matters most: median $0.69 against $1.83, 62% less.
- you serve LLMs: memory bandwidth per dollar is better ($0.385 per TB/s-hour against $1.177).
- you want choice: 25 providers have a fresh offer today against 22.
Questions about A100 40GB vs RTX 5090
Which is cheaper to rent, the A100 40GB or the RTX 5090?
Today the cheapest current on-demand A100 40GB is $0.58 per GPU-hour and the cheapest RTX 5090 is $0.22; medians are $1.83 and $0.69. Cheapest excludes offers marked unavailable and counts one floor per marketplace.
How much memory do the A100 40GB and RTX 5090 have?
40 GB of HBM2 on the A100 40GB, 32 GB of GDDR7 on the RTX 5090, at 1.55 and 1.79 TB/s.
Where do these numbers come from?
From 111 current offers read on the providers' own pages and APIs over the last 45 days (reference 00:32 UTC), or in our October 2026 market study for the few providers our collector does not read. Specifications come from manufacturer datasheets. Every price on the GPU pages links to its receipt and shows its read date.
