gpurank
esc
  • Nothing named “”. Press Enter to search the offers instead.
↑↓ to move · ↵ to open · esc to close0 entries
Meituan · Chat and reasoning · 69.1B parameters · mit

LongCat Flash Lite

Needs 83 GB at FP8 / INT8. The smallest real configuration today is 4× RTX 3090 at Clore.ai, $0.25 per hour, about $183 a month at 730 hours.

Parameters69.1Bdense
Context320k tokensmaximum published
Checkpoint138 GBBF16, as published
Licensemitcheck before commercial use
Released—documented date
Smallest configuration · FP8 / INT8
4× RTX 309096 GB VRAM · 86% used
Per hour
$0.25
Per month
$183
Cheapest at
Clore.ai
All RTX 3090 offers →
Memory · 3 precisions · 6 context lengths

How much VRAM it needs

Weights plus runtime overhead, then the KV cache that grows with the context you serve.

PrecisionWeightsWeights + headroom4k context32k context128k context256k context320k context
BF16published checkpoint138 GB166 GB166 GB167 GB168 GB171 GB172 GB
FP8 / INT8estimated69 GB83 GB83 GB84 GB86 GB88 GB89 GB
INT4 / MXFP4estimated41 GB50 GB50 GB51 GB52 GB54 GB56 GB
KV cacheone sequence, FP16 cache, included above——1 GB1 GB3 GB5 GB6 GB
Cross-checked on Hugging Face Oct 28, 2026: 69.1B parameters in the safetensors headers, 138.2 GB of weight files, attention layout from config.json (14 layers, latent rank 512). Method: weights as published at the native precision, verified on Hugging Face 2026-10-28; other precisions estimated at 1 (8-bit) and 0.6 (4-bit) bytes per parameter; × 1.2 runtime headroom; KV cache = 1152 bytes per token per layer × 14 full-attention layers (FP16 cache, one sequence).config.json ↗
Smallest configuration per GPU · 110 GPUs · cheapest eligible on-demand offer per GPU count, every provider on file

What it costs to run, GPU by GPU

The fewest GPUs of one type whose total memory fits the model at short context, priced from the cheapest eligible on-demand offer for exactly that count (45-day window, newest reading per provider), with the next providers beside it. Monthly = 730 hours.

GPUSmallest configVRAM used$ / hour$ / monthCheapest at
RTX 3090Best fit4× 24 GB96 GB total86%$0.25$183Clore.aiTrust 46 · read Nov 2 · receipt · also Vast.ai $0.56, Edgevana $0.92
Tesla V100 32GB4× 32 GB128 GB total65%$0.27$196Vast.aiTrust 78 · read Nov 2 · receipt · also Cyfuture AI $2.22, gcube $6.44
RTX A60002× 48 GB96 GB total86%$0.38$274Clore.aiTrust 46 · read Nov 2 · receipt · also Lium $0.84, Spheron $0.89
Tesla P1008× 16 GB128 GB total65%$0.38$274Vast.aiTrust 78 · read Nov 2 · receipt
RTX 30608× 12 GB96 GB total86%$0.43$312Vast.aiTrust 78 · read Nov 2 · receipt · also Edgevana $0.64, AtmosCompute $1.01
Quadro RTX 80002× 48 GB96 GB total86%$0.48$354Vast.aiTrust 78 · read Nov 2 · receipt · also Edgevana $0.56
L402× 48 GB96 GB total86%$0.54$391Vast.aiTrust 78 · read Nov 2 · receipt · also io.net $1.32, GPU.ai $1.56
RTX 2080 Ti8× 11 GB88 GB total94% tight$0.59$432Vast.aiTrust 78 · read Nov 2 · receipt · also Edgevana $0.68
RTX PRO 60001× 96 GB96 GB total86%$0.66$482packet.ainot scored · read Nov 2 · receipt · also Runpod $0.69, HyperAI $0.80
Titan RTX4× 24 GB96 GB total86%$0.70$508Vast.aiTrust 78 · read Nov 2 · receipt
Tesla V100 16GB8× 16 GB128 GB total65%$0.75$547Vast.aiTrust 78 · read Nov 2 · receipt · also CloudRift $2.32, Lambda $6.32
L40S2× 48 GB96 GB total86%$0.76$555LiumTrust 40 · read Nov 2 · receipt · also Vast.ai $1.07, CloudRift $1.26
RTX A50004× 24 GB96 GB total86%$0.80$586Vast.aiTrust 78 · read Nov 2 · receipt · also Edgevana $1.05
RTX 5060 Ti8× 16 GB128 GB total65%$0.82$596Clore.aiTrust 46 · read Nov 2 · receipt · also Vast.ai $0.86, Edgevana $0.98
RTX PRO 40004× 24 GB96 GB total86%$0.83$608Clore.aiTrust 46 · read Nov 2 · receipt · also Vast.ai $1.55, Edgevana $1.78
RTX 4070 Super8× 12 GB96 GB total86%$0.85$617Vast.aiTrust 78 · read Nov 2 · receipt · also AtmosCompute $1.36
A402× 48 GB96 GB total86%$0.94$683Vast.aiTrust 78 · read Nov 2 · receipt · also Exoscale $2.09
A800 80GB PCIe2× 80 GB160 GB total52%$0.96$702Vast.aiTrust 78 · read Nov 2 · receipt
RTX PRO 50002× 48 GB96 GB total86%$0.96$702Vast.aiTrust 78 · read Nov 2 · receipt · also Lium $1.70, AtmosCompute $2.04
A104× 24 GB96 GB total86%$0.96$703Vast.aiTrust 78 · read Nov 2 · receipt · also Volcano Engine $6.39
RTX A40008× 16 GB128 GB total65%$0.96$704Vast.aiTrust 78 · read Nov 2 · receipt
RTX 6000 Ada2× 48 GB96 GB total86%$0.99$722Vast.aiTrust 78 · read Nov 2 · receipt · also GPU.ai $1.30, io.net $1.37
Gaudi 21× 96 GB96 GB total86%$1.06$777Cyfuture AInot scored · read Nov 2 · receipt
RTX 40904× 24 GB96 GB total86%$1.08$791Clore.aiTrust 46 · read Nov 2 · receipt · also Vast.ai $1.50, Lium $2.00
The 24 cheapest of 61 GPU types that fit. Every GPU, any precision and context, in the finder
Throughput estimates · Oct 4, 2026

Tokens per second, and what a million costs

Chat and reasoning. Speed estimated from memory bandwidth and model size, never measured. The cost per 1M output tokens is an estimate at the prices read on Oct 4, 2026; it is not recomputed here.

GPUCardsPrecisiontok/s per userper 1M output tokens · estimate
MI300X1FP840.6$0.428
RTX 40904FP825.1$0.500
B2001FP873.8$0.539
H100 SXM2FP856.9$0.605
H2001FP845.8$0.637
RTX PRO 60001FP817.8$0.645
L40S2FP813.6$0.652
H100 PCIe2FP830.2$0.746
RTX 50904FP842.8$0.764
A100 80GB2BF1618.9$1.54
cards, precision and speed estimated from memory bandwidth and model size; cost recomputed by the site from verified prices · cheapest per output at the prices of Oct 4, 2026: MI300XWhy estimates, and their limits →