ERNIE Image
Needs 10 GB at FP8 / INT8. The smallest real configuration today is 1× RTX 3060 at Vast.ai, $0.04 per hour, about $26 a month at 730 hours.
- Per hour
- $0.04
- Per month
- $26
- Cheapest at
Vast.ai
How much VRAM it needs
Weights plus 20% runtime overhead. For image generation models, activations also depend on resolution, clip length and batch size; the per-GPU estimates below give the practical configuration.
| Precision | Weights | Weights + headroom |
|---|---|---|
| BF16published checkpoint | 32 GB | 38 GB |
| FP8 / INT8estimated | 8 GB | 10 GB |
| INT4 / MXFP4estimated | 5 GB | 6 GB |
What it costs to run, GPU by GPU
The fewest GPUs of one type whose total memory fits the model at short context, priced from the cheapest eligible on-demand offer for exactly that count (45-day window, newest reading per provider), with the next providers beside it. Monthly = 730 hours.
| GPU | Smallest config | VRAM used | $ / hour | $ / month | Cheapest at |
|---|---|---|---|---|---|
| RTX 3060Best fit | 1× 12 GB12 GB total | 80% | $0.04 | $26 | |
| RTX A2000 | 1× 12 GB12 GB total | 80% | $0.04 | $26 | |
| T4 | 1× 16 GB16 GB total | 60% | $0.04 | $29 | |
| Tesla P40 | 1× 24 GB24 GB total | 40% | $0.04 | $30 | |
| GTX Titan X | 1× 12 GB12 GB total | 80% | $0.04 | $31 | |
| Titan Xp | 1× 12 GB12 GB total | 80% | $0.04 | $31 | |
| Tesla P100 | 1× 16 GB16 GB total | 60% | $0.04 | $33 | |
| Quadro P2000 | 2× 5 GB10 GB total | 96% tight | $0.06 | $41 | |
| GTX 1080 Ti | 1× 11 GB11 GB total | 88% | $0.06 | $45 | |
| RTX A4000 | 1× 16 GB16 GB total | 60% | $0.06 | $46 | |
| Tesla V100 16GB | 1× 16 GB16 GB total | 60% | $0.06 | $46 | |
| RTX 2080 Ti | 1× 11 GB11 GB total | 88% | $0.07 | $49 | |
| Tesla V100 32GB | 1× 32 GB32 GB total | 30% | $0.07 | $50 | |
| RTX PRO 2000 | 1× 16 GB16 GB total | 60% | $0.07 | $51 | |
| Tesla M40 | 1× 24 GB24 GB total | 40% | $0.07 | $54 | |
| RTX 3080 | 1× 10 GB10 GB total | 96% tight | $0.07 | $55 | |
| RTX 3080 Ti | 1× 12 GB12 GB total | 80% | $0.08 | $60 | |
| RTX 4070 | 1× 12 GB12 GB total | 80% | $0.08 | $61 | |
| GTX 1660 | 2× 6 GB12 GB total | 80% | $0.09 | $64 | |
| RTX 5060 Ti | 1× 16 GB16 GB total | 60% | $0.09 | $64 | |
| RTX 3090 | 1× 24 GB24 GB total | 40% | $0.09 | $66 | Akash NetworkTrust 53 · read Nov 1 · receipt · also Vast.ai $0.10, Clore.ai $0.11 |
| RTX 4070 Super | 1× 12 GB12 GB total | 80% | $0.10 | $70 | |
| GTX 1070 | 2× 8 GB16 GB total | 60% | $0.10 | $70 | |
| GTX 1070 Ti | 2× 8 GB16 GB total | 60% | $0.10 | $76 | |
| The 24 cheapest of 100 GPU types that fit. Every GPU, any precision and context, in the finder | |||||
Estimated speed, in s per image
Image generation. Speed estimated from memory bandwidth and model size, never measured. The cost per 1,000 images is an estimate at the prices read on Oct 4, 2026; it is not recomputed here.
| GPU | Cards | Precision | s per image | per 1,000 images · estimate |
|---|---|---|---|---|
| RTX 4090 | 1 | FP8 | 6.4 | $0.410 |
| RTX 5090 | 1 | FP8 | 3.8 | $0.500 |
| L40S | 1 | FP8 | 5.3 | $0.800 |
| RTX PRO 6000 | 1 | FP8 | 2.7 | $0.860 |
| H100 SXM | 1 | FP8 | 2.2 | $1.11 |
| H100 PCIe | 1 | FP8 | 3.0 | $1.11 |
| B200 | 1 | FP8 | 1.1 | $1.25 |
| A100 80GB | 1 | BF16 | 5.1 | $1.34 |
| H200 | 1 | FP8 | 2.0 | $1.40 |
| MI300X | 1 | FP8 | 3.1 | $1.42 |
