Cosmos3 Super Text2Image
Needs 78 GB at FP8 / INT8. The smallest real configuration today is 4× RTX 3090 at Clore.ai, $0.25 per hour, about $183 a month at 730 hours.
- Per hour
- $0.25
- Per month
- $183
- Cheapest at
Clore.ai
How much VRAM it needs
Weights plus 20% runtime overhead. For image generation models, activations also depend on resolution, clip length and batch size; the per-GPU estimates below give the practical configuration.
| Precision | Weights | Weights + headroom |
|---|---|---|
| BF16published checkpoint | 129 GB | 156 GB |
| FP8 / INT8estimated | 65 GB | 78 GB |
| INT4 / MXFP4estimated | 39 GB | 47 GB |
What it costs to run, GPU by GPU
The fewest GPUs of one type whose total memory fits the model at short context, priced from the cheapest eligible on-demand offer for exactly that count (45-day window, newest reading per provider), with the next providers beside it. Monthly = 730 hours.
| GPU | Smallest config | VRAM used | $ / hour | $ / month | Cheapest at |
|---|---|---|---|---|---|
| RTX 3090Best fit | 4× 24 GB96 GB total | 81% | $0.25 | $183 | |
| Tesla V100 32GB | 4× 32 GB128 GB total | 61% | $0.27 | $196 | |
| RTX A6000 | 2× 48 GB96 GB total | 81% | $0.38 | $274 | |
| Tesla P100 | 8× 16 GB128 GB total | 61% | $0.38 | $274 | |
| RTX 3060 | 8× 12 GB96 GB total | 81% | $0.43 | $312 | |
| A800 80GB PCIe | 1× 80 GB80 GB total | 97% tight | $0.47 | $342 | |
| Quadro RTX 8000 | 2× 48 GB96 GB total | 81% | $0.48 | $354 | |
| L40 | 2× 48 GB96 GB total | 81% | $0.54 | $391 | |
| RTX 2080 Ti | 8× 11 GB88 GB total | 88% | $0.59 | $432 | |
| A100 80GB | 1× 80 GB80 GB total | 97% tight | $0.60 | $440 | |
| RTX PRO 6000 | 1× 96 GB96 GB total | 81% | $0.66 | $482 | |
| Titan RTX | 4× 24 GB96 GB total | 81% | $0.70 | $508 | |
| Tesla V100 16GB | 8× 16 GB128 GB total | 61% | $0.75 | $547 | |
| L40S | 2× 48 GB96 GB total | 81% | $0.76 | $555 | |
| A100 40GB | 2× 40 GB80 GB total | 97% tight | $0.77 | $566 | |
| RTX A5000 | 4× 24 GB96 GB total | 81% | $0.80 | $586 | |
| RTX 5060 Ti | 8× 16 GB128 GB total | 61% | $0.82 | $596 | |
| RTX PRO 4000 | 4× 24 GB96 GB total | 81% | $0.83 | $608 | |
| RTX 4070 Super | 8× 12 GB96 GB total | 81% | $0.85 | $617 | |
| A40 | 2× 48 GB96 GB total | 81% | $0.94 | $683 | |
| RTX PRO 5000 | 2× 48 GB96 GB total | 81% | $0.96 | $702 | |
| A10 | 4× 24 GB96 GB total | 81% | $0.96 | $703 | |
| RTX A4000 | 8× 16 GB128 GB total | 61% | $0.96 | $704 | |
| RTX 6000 Ada | 2× 48 GB96 GB total | 81% | $0.99 | $722 | |
| The 24 cheapest of 61 GPU types that fit. Every GPU, any precision and context, in the finder | |||||
Estimated speed, in s per image
Image generation. Speed estimated from memory bandwidth and model size, never measured. The cost per 1,000 images is an estimate at the prices read on Oct 4, 2026; it is not recomputed here.
| GPU | Cards | Precision | s per image | per 1,000 images · estimate |
|---|---|---|---|---|
| B200 | 1 | FP8 | 8.7 | $10.00 |
| H200 | 1 | FP8 | 16.3 | $11.30 |
| MI300X | 1 | FP8 | 25.0 | $11.40 |
