MiniCPM-V 4.7 35B-A3B
Needs 43 GB at FP8 / INT8. The smallest real configuration today is 2× Tesla V100 32GB at Vast.ai, $0.14 per hour, about $99 a month at 730 hours.
- Per hour
- $0.14
- Per month
- $99
- Cheapest at
Vast.ai
What is documented about MiniCPM-V 4.7 35B-A3B
news checked 2026-10-27The first MoE model in the MiniCPM-V series: single-image, multi-image and video understanding, built for on-device use with Lookahead Expert Scheduling. 'A3B' is in the name; the card does not state an exact active count. 256 experts, 8 active. 30 linear + 10 full-attention layers. The weights appeared on HF around 6-7 Oct without a card (OrcaRouter); the card and Apache-2.0 tag were added later.
- https://huggingface.co/openbmb/MiniCPM-V-4.7-35B-A3B
- https://huggingface.co/openbmb/MiniCPM-V-4.7-35B-A3B/raw/main/config.json
- https://huggingface.co/api/models/openbmb/MiniCPM-V-4.7-35B-A3B?blobs=true
How much VRAM it needs
Weights plus runtime overhead, then the KV cache that grows with the context you serve.
| Precision | Weights | Weights + headroom | 4k context | 32k context | 128k context | 256k context |
|---|---|---|---|---|---|---|
| BF16published checkpoint | 70 GB | 85 GB | 85 GB | 88 GB | 96 GB | 106 GB |
| FP8 / INT8estimated | 35 GB | 43 GB | 43 GB | 45 GB | 53 GB | 64 GB |
| INT4 / MXFP4estimated | 21 GB | 26 GB | 26 GB | 29 GB | 37 GB | 47 GB |
| KV cacheone sequence, FP16 cache, included above | — | — | 1 GB | 3 GB | 11 GB | 22 GB |
What it costs to run, GPU by GPU
The fewest GPUs of one type whose total memory fits the model at short context, priced from the cheapest eligible on-demand offer for exactly that count (45-day window, newest reading per provider), with the next providers beside it. Monthly = 730 hours.
| GPU | Smallest config | VRAM used | $ / hour | $ / month | Cheapest at |
|---|---|---|---|---|---|
| Tesla V100 32GBBest fit | 2× 32 GB64 GB total | 66% | $0.14 | $99 | |
| RTX 3060 | 4× 12 GB48 GB total | 88% | $0.16 | $118 | |
| Tesla P100 | 4× 16 GB64 GB total | 66% | $0.19 | $142 | |
| RTX 3090 | 2× 24 GB48 GB total | 88% | $0.21 | $157 | |
| Quadro RTX 8000 | 1× 48 GB48 GB total | 88% | $0.23 | $167 | |
| Titan RTX | 2× 24 GB48 GB total | 88% | $0.27 | $196 | |
| Titan Xp | 4× 12 GB48 GB total | 88% | $0.27 | $196 | |
| L40 | 1× 48 GB48 GB total | 88% | $0.27 | $196 | |
| RTX 2080 Ti | 4× 11 GB44 GB total | 96% tight | $0.28 | $202 | |
| RTX A6000 | 1× 48 GB48 GB total | 88% | $0.33 | $241 | |
| A40 | 1× 48 GB48 GB total | 88% | $0.35 | $255 | |
| RTX 6000 | 2× 24 GB48 GB total | 88% | $0.35 | $256 | |
| RTX 5060 Ti | 4× 16 GB64 GB total | 66% | $0.35 | $258 | |
| RTX A4000 | 4× 16 GB64 GB total | 66% | $0.36 | $266 | |
| RTX A5000 | 2× 24 GB48 GB total | 88% | $0.38 | $274 | |
| RTX 4070 Super | 4× 12 GB48 GB total | 88% | $0.38 | $274 | |
| Tesla V100 16GB | 4× 16 GB64 GB total | 66% | $0.38 | $275 | |
| RTX 6000 Ada | 1× 48 GB48 GB total | 88% | $0.40 | $290 | |
| RTX PRO 5000 | 1× 48 GB48 GB total | 88% | $0.40 | $294 | |
| Quadro RTX 5000 | 4× 16 GB64 GB total | 66% | $0.40 | $294 | |
| RTX 3090 Ti | 2× 24 GB48 GB total | 88% | $0.42 | $304 | |
| L40S | 1× 48 GB48 GB total | 88% | $0.42 | $304 | |
| RTX PRO 4000 | 2× 24 GB48 GB total | 88% | $0.45 | $332 | |
| A800 80GB PCIe | 1× 80 GB80 GB total | 53% | $0.47 | $342 | |
| The 24 cheapest of 73 GPU types that fit. Every GPU, any precision and context, in the finder | |||||
