F5 TTS
Needs 1 GB at FP8 / INT8. The smallest real configuration today is 1× Quadro P2000 at Vast.ai, $0.03 per hour, about $22 a month at 730 hours.
- Per hour
- $0.03
- Per month
- $22
- Cheapest at
Vast.ai
How much VRAM it needs
Weights plus 20% runtime overhead. For voice models, activations also depend on resolution, clip length and batch size; the per-GPU estimates below give the practical configuration.
| Precision | Weights | Weights + headroom |
|---|---|---|
| BF16published checkpoint | 4 GB | 5 GB |
| FP8 / INT8estimated | 0 GB | 1 GB |
| INT4 / MXFP4estimated | 0 GB | 1 GB |
What it costs to run, GPU by GPU
The fewest GPUs of one type whose total memory fits the model at short context, priced from the cheapest eligible on-demand offer for exactly that count (45-day window, newest reading per provider), with the next providers beside it. Monthly = 730 hours.
| GPU | Smallest config | VRAM used | $ / hour | $ / month | Cheapest at |
|---|---|---|---|---|---|
| Quadro P2000Best fit | 1× 5 GB5 GB total | 8% | $0.03 | $22 | |
| RTX 3060 | 1× 12 GB12 GB total | 3% | $0.04 | $26 | |
| GTX 1660 | 1× 6 GB6 GB total | 7% | $0.04 | $26 | |
| RTX A2000 | 1× 12 GB12 GB total | 3% | $0.04 | $26 | |
| GTX 1660 Ti | 1× 6 GB6 GB total | 7% | $0.04 | $26 | |
| GTX 1050 | 1× 2 GB2 GB total | 21% | $0.04 | $27 | |
| Tesla P4 | 1× 8 GB8 GB total | 5% | $0.04 | $29 | |
| T4 | 1× 16 GB16 GB total | 3% | $0.04 | $29 | |
| GTX 1060 | 1× 6 GB6 GB total | 7% | $0.04 | $30 | |
| Tesla P40 | 1× 24 GB24 GB total | 2% | $0.04 | $30 | |
| GTX Titan X | 1× 12 GB12 GB total | 3% | $0.04 | $31 | |
| Titan Xp | 1× 12 GB12 GB total | 3% | $0.04 | $31 | |
| GTX 1080 | 1× 8 GB8 GB total | 5% | $0.04 | $32 | |
| Tesla P100 | 1× 16 GB16 GB total | 3% | $0.04 | $33 | |
| RTX 2060 | 1× 6 GB6 GB total | 7% | $0.04 | $33 | |
| GTX 1650 | 1× 4 GB4 GB total | 10% | $0.05 | $35 | |
| GTX 1070 | 1× 8 GB8 GB total | 5% | $0.05 | $36 | |
| GTX 1660 Super | 1× 6 GB6 GB total | 7% | $0.05 | $38 | |
| RTX 4060 | 1× 8 GB8 GB total | 5% | $0.05 | $40 | |
| RTX 2070 | 1× 8 GB8 GB total | 5% | $0.06 | $41 | |
| RTX 3060 Ti | 1× 8 GB8 GB total | 5% | $0.06 | $41 | |
| RTX 2060 Super | 1× 8 GB8 GB total | 5% | $0.06 | $41 | |
| GTX 1070 Ti | 1× 8 GB8 GB total | 5% | $0.06 | $44 | |
| RTX 2070 Super | 1× 8 GB8 GB total | 5% | $0.06 | $44 | |
| The 24 cheapest of 110 GPU types that fit. Every GPU, any precision and context, in the finder | |||||
Estimated speed, in × realtime
Voice. Speed estimated from memory bandwidth and model size, never measured. The cost per 1,000 hours of speech is an estimate at the prices read on Oct 4, 2026; it is not recomputed here.
| GPU | Cards | Precision | × realtime | per 1,000 hours of speech · estimate |
|---|---|---|---|---|
| RTX 4090 | 1 | BF16 | 10.8 | $3.54 |
| RTX 5090 | 1 | BF16 | 14.2 | $5.65 |
| L40S | 1 | BF16 | 11.1 | $8.24 |
| MI300X | 1 | BF16 | 29.5 | $9.33 |
| H100 PCIe | 1 | BF16 | 21.2 | $10.60 |
| H100 SXM | 1 | BF16 | 28.1 | $11.00 |
| RTX PRO 6000 | 1 | BF16 | 15.9 | $12.00 |
| B200 | 1 | BF16 | 57.0 | $12.10 |
| A100 80GB | 1 | BF16 | 12.0 | $13.20 |
| H200 | 1 | BF16 | 30.1 | $13.80 |
