Qwen3 TTS 12Hz 1.7B VoiceDesign
Needs 3 GB at FP8 / INT8. The smallest real configuration today is 1× Quadro P2000 at Vast.ai, $0.03 per hour, about $22 a month at 730 hours.
- Per hour
- $0.03
- Per month
- $22
- Cheapest at
Vast.ai
How much VRAM it needs
Weights plus 20% runtime overhead. For voice models, activations also depend on resolution, clip length and batch size; the per-GPU estimates below give the practical configuration.
| Precision | Weights | Weights + headroom |
|---|---|---|
| BF16published checkpoint | 4 GB | 5 GB |
| FP8 / INT8estimated | 2 GB | 3 GB |
| INT4 / MXFP4estimated | 1 GB | 2 GB |
What it costs to run, GPU by GPU
The fewest GPUs of one type whose total memory fits the model at short context, priced from the cheapest eligible on-demand offer for exactly that count (45-day window, newest reading per provider), with the next providers beside it. Monthly = 730 hours.
| GPU | Smallest config | VRAM used | $ / hour | $ / month | Cheapest at |
|---|---|---|---|---|---|
| Quadro P2000Best fit | 1× 5 GB5 GB total | 46% | $0.03 | $22 | |
| RTX 3060 | 1× 12 GB12 GB total | 19% | $0.04 | $26 | |
| GTX 1660 | 1× 6 GB6 GB total | 38% | $0.04 | $26 | |
| RTX A2000 | 1× 12 GB12 GB total | 19% | $0.04 | $26 | |
| GTX 1660 Ti | 1× 6 GB6 GB total | 38% | $0.04 | $26 | |
| Tesla P4 | 1× 8 GB8 GB total | 29% | $0.04 | $29 | |
| T4 | 1× 16 GB16 GB total | 14% | $0.04 | $29 | |
| GTX 1060 | 1× 6 GB6 GB total | 38% | $0.04 | $30 | |
| Tesla P40 | 1× 24 GB24 GB total | 10% | $0.04 | $30 | |
| GTX Titan X | 1× 12 GB12 GB total | 19% | $0.04 | $31 | |
| Titan Xp | 1× 12 GB12 GB total | 19% | $0.04 | $31 | |
| GTX 1080 | 1× 8 GB8 GB total | 29% | $0.04 | $32 | |
| Tesla P100 | 1× 16 GB16 GB total | 14% | $0.04 | $33 | |
| RTX 2060 | 1× 6 GB6 GB total | 38% | $0.04 | $33 | |
| GTX 1650 | 1× 4 GB4 GB total | 57% | $0.05 | $35 | |
| GTX 1070 | 1× 8 GB8 GB total | 29% | $0.05 | $36 | |
| GTX 1660 Super | 1× 6 GB6 GB total | 38% | $0.05 | $38 | |
| RTX 4060 | 1× 8 GB8 GB total | 29% | $0.05 | $40 | |
| RTX 2070 | 1× 8 GB8 GB total | 29% | $0.06 | $41 | |
| RTX 3060 Ti | 1× 8 GB8 GB total | 29% | $0.06 | $41 | |
| RTX 2060 Super | 1× 8 GB8 GB total | 29% | $0.06 | $41 | |
| GTX 1070 Ti | 1× 8 GB8 GB total | 29% | $0.06 | $44 | |
| RTX 2070 Super | 1× 8 GB8 GB total | 29% | $0.06 | $44 | |
| RTX 3070 | 1× 8 GB8 GB total | 29% | $0.06 | $44 | |
| The 24 cheapest of 109 GPU types that fit. Every GPU, any precision and context, in the finder | |||||
Estimated speed, in × realtime
Voice. Speed estimated from memory bandwidth and model size, never measured. The cost per 1,000 hours of speech is an estimate at the prices read on Oct 4, 2026; it is not recomputed here.
| GPU | Cards | Precision | × realtime | per 1,000 hours of speech · estimate |
|---|---|---|---|---|
| RTX 4090 | 1 | BF16 | 9.0 | $2.56 |
| RTX 5090 | 1 | BF16 | 11.8 | $4.08 |
| L40S | 1 | BF16 | 9.3 | $5.94 |
| MI300X | 1 | BF16 | 24.5 | $6.73 |
| H100 PCIe | 1 | BF16 | 17.7 | $7.64 |
| H100 SXM | 1 | BF16 | 23.3 | $7.93 |
| RTX PRO 6000 | 1 | BF16 | 13.3 | $8.67 |
| B200 | 1 | BF16 | 47.4 | $8.76 |
| A100 80GB | 1 | BF16 | 10.0 | $9.52 |
| H200 | 1 | BF16 | 25.1 | $9.93 |
