LFM2.5-24B-A2B
Needs 29 GB at FP8 / INT8. The smallest real configuration today is 1× Tesla V100 32GB at Vast.ai, $0.07 per hour, about $50 a month at 730 hours.
- Per hour
- $0.07
- Per month
- $50
- Cheapest at
Vast.ai
What is documented about LFM2.5-24B-A2B
news checked 2026-10-27Card: 'Total parameters 24.0B, Active parameters 2.45B', 40 layers (30 double-gated short-convolution blocks + 10 GQA), 64 experts with top-4 routing, 131,072 context. head_dim = 2048/32. Card calls it 'the largest and final model in the LFM2.5 family'. Liquid blog and MarkTechPost date it 13-14 Oct; HF first commit 2026-10-13. A base model is also published.
- https://huggingface.co/LiquidAI/LFM2.5-24B-A2B
- https://huggingface.co/LiquidAI/LFM2.5-24B-A2B/raw/main/config.json
- https://huggingface.co/api/models/LiquidAI/LFM2.5-24B-A2B?blobs=true
How much VRAM it needs
Weights plus runtime overhead, then the KV cache that grows with the context you serve.
| Precision | Weights | Weights + headroom | 4k context | 32k context | 128k context |
|---|---|---|---|---|---|
| BF16published checkpoint | 48 GB | 58 GB | 58 GB | 61 GB | 69 GB |
| FP8 / INT8estimated | 24 GB | 29 GB | 30 GB | 32 GB | 40 GB |
| INT4 / MXFP4estimated | 14 GB | 18 GB | 18 GB | 20 GB | 29 GB |
| KV cacheone sequence, FP16 cache, included above | — | — | 1 GB | 3 GB | 11 GB |
What it costs to run, GPU by GPU
The fewest GPUs of one type whose total memory fits the model at short context, priced from the cheapest eligible on-demand offer for exactly that count (45-day window, newest reading per provider), with the next providers beside it. Monthly = 730 hours.
| GPU | Smallest config | VRAM used | $ / hour | $ / month | Cheapest at |
|---|---|---|---|---|---|
| Tesla V100 32GBBest fit | 1× 32 GB32 GB total | 90% | $0.07 | $50 | |
| T4 | 2× 16 GB32 GB total | 90% | $0.08 | $59 | |
| Tesla P100 | 2× 16 GB32 GB total | 90% | $0.10 | $70 | |
| RTX A4000 | 2× 16 GB32 GB total | 90% | $0.14 | $105 | |
| RTX PRO 2000 | 2× 16 GB32 GB total | 90% | $0.15 | $106 | |
| RTX 3060 | 4× 12 GB48 GB total | 60% | $0.16 | $118 | |
| RTX 5060 Ti | 2× 16 GB32 GB total | 90% | $0.19 | $137 | |
| Tesla V100 16GB | 2× 16 GB32 GB total | 90% | $0.19 | $138 | |
| Quadro RTX 5000 | 2× 16 GB32 GB total | 90% | $0.20 | $148 | |
| GTX 1080 | 4× 8 GB32 GB total | 90% | $0.20 | $150 | |
| RTX 3090 | 2× 24 GB48 GB total | 60% | $0.21 | $157 | |
| RTX 2070 | 4× 8 GB32 GB total | 90% | $0.22 | $157 | |
| RTX 5090 | 1× 32 GB32 GB total | 90% | $0.22 | $158 | |
| RTX 3060 Ti | 4× 8 GB32 GB total | 90% | $0.22 | $159 | |
| Quadro RTX 8000 | 1× 48 GB48 GB total | 60% | $0.23 | $167 | |
| GTX 1070 Ti | 4× 8 GB32 GB total | 90% | $0.23 | $169 | |
| RTX 2070 Super | 4× 8 GB32 GB total | 90% | $0.24 | $177 | |
| Titan RTX | 2× 24 GB48 GB total | 60% | $0.27 | $196 | |
| Titan Xp | 4× 12 GB48 GB total | 60% | $0.27 | $196 | |
| L40 | 1× 48 GB48 GB total | 60% | $0.27 | $196 | |
| RTX 2080 Ti | 4× 11 GB44 GB total | 65% | $0.28 | $202 | |
| RTX 4070 Ti Super | 2× 16 GB32 GB total | 90% | $0.29 | $213 | |
| RTX 5070 Ti | 2× 16 GB32 GB total | 90% | $0.32 | $235 | |
| RTX A6000 | 1× 48 GB48 GB total | 60% | $0.33 | $241 | |
| The 24 cheapest of 82 GPU types that fit. Every GPU, any precision and context, in the finder | |||||
