Size up your next model.

What this estimate includes.

Weights + 20% inference overhead (6× for training) + heuristic KV cache + 2 GiB runtime. KV depends on architecture, layers and batching; validate against your model.

Recommendations include 15% headroom. This is a memory estimate, not a performance or deployability guarantee. Multi-GPU models require compatible software and interconnects.