Flint
Needs 48 GB at FP8 / INT8. The smallest real configuration today is 2× Tesla V100 32GB at Vast.ai, $0.14 per hour, about $99 a month at 730 hours.
- Per hour
- $0.14
- Per month
- $99
- Cheapest at
Vast.ai
What is documented about Flint
news checked 2026-10-27Trained from scratch for coding agents. Card: 39.8B total, about 2.5B active including the output head. 49 layers = 2 dense + 47 MoE (35 sliding + 14 full attention). 256 experts, 6 active, plus a shared expert. #2 on HF trending on 2026-10-27. Benchmarks are self-reported.
- https://huggingface.co/RecursiveSI/flint
- https://huggingface.co/RecursiveSI/flint/raw/main/config.json
- https://huggingface.co/api/models/RecursiveSI/flint?blobs=true
How much VRAM it needs
Weights plus runtime overhead, then the KV cache that grows with the context you serve.
| Precision | Weights | Weights + headroom | 4k context | 32k context | 128k context | 256k context |
|---|---|---|---|---|---|---|
| BF16published checkpoint | 80 GB | 96 GB | 96 GB | 97 GB | 100 GB | 104 GB |
| FP8 / INT8estimated | 40 GB | 48 GB | 48 GB | 49 GB | 52 GB | 56 GB |
| INT4 / MXFP4estimated | 24 GB | 29 GB | 29 GB | 30 GB | 33 GB | 37 GB |
| KV cacheone sequence, FP16 cache, included above | — | — | 1 GB | 1 GB | 4 GB | 8 GB |
What it costs to run, GPU by GPU
The fewest GPUs of one type whose total memory fits the model at short context, priced from the cheapest eligible on-demand offer for exactly that count (45-day window, newest reading per provider), with the next providers beside it. Monthly = 730 hours.
| GPU | Smallest config | VRAM used | $ / hour | $ / month | Cheapest at |
|---|---|---|---|---|---|
| Tesla V100 32GBBest fit | 2× 32 GB64 GB total | 75% | $0.14 | $99 | |
| T4 | 4× 16 GB64 GB total | 75% | $0.16 | $117 | |
| RTX 3060 | 4× 12 GB48 GB total | 100% tight | $0.16 | $119 | |
| Tesla P100 | 4× 16 GB64 GB total | 75% | $0.19 | $138 | |
| RTX 3090 | 2× 24 GB48 GB total | 100% tight | $0.21 | $157 | |
| Quadro RTX 8000 | 1× 48 GB48 GB total | 100% tight | $0.25 | $186 | |
| RTX 6000 | 2× 24 GB48 GB total | 100% tight | $0.27 | $196 | |
| Titan RTX | 2× 24 GB48 GB total | 100% tight | $0.27 | $196 | |
| Titan Xp | 4× 12 GB48 GB total | 100% tight | $0.27 | $196 | |
| L40 | 1× 48 GB48 GB total | 100% tight | $0.27 | $196 | |
| RTX A6000 | 1× 48 GB48 GB total | 100% tight | $0.33 | $241 | GPURentonot scored · read Nov 1 · receipt · also gcube $0.34, Thunder Compute $0.35 |
| A40 | 1× 48 GB48 GB total | 100% tight | $0.35 | $255 | GPURentonot scored · read Nov 1 · receipt · also Vast.ai $0.48, Exoscale $1.05 |
| RTX 5060 Ti | 4× 16 GB64 GB total | 75% | $0.35 | $258 | |
| RTX A4000 | 4× 16 GB64 GB total | 75% | $0.36 | $266 | |
| RTX A5000 | 2× 24 GB48 GB total | 100% tight | $0.38 | $274 | |
| RTX 4070 Super | 4× 12 GB48 GB total | 100% tight | $0.38 | $274 | |
| Tesla V100 16GB | 4× 16 GB64 GB total | 75% | $0.38 | $275 | |
| RTX 6000 Ada | 1× 48 GB48 GB total | 100% tight | $0.40 | $290 | |
| Quadro RTX 5000 | 4× 16 GB64 GB total | 75% | $0.40 | $294 | |
| RTX 3090 Ti | 2× 24 GB48 GB total | 100% tight | $0.42 | $304 | |
| L40S | 1× 48 GB48 GB total | 100% tight | $0.43 | $314 | |
| RTX PRO 4000 | 2× 24 GB48 GB total | 100% tight | $0.45 | $332 | |
| A800 80GB PCIe | 1× 80 GB80 GB total | 60% | $0.47 | $342 | |
| A10 | 2× 24 GB48 GB total | 100% tight | $0.48 | $352 | |
| The 24 cheapest of 73 GPU types that fit. Every GPU, any precision and context, in the finder | |||||
