The number on the GPU box is not your inference budget.

Windows, the display pipeline, browsers and other applications already occupy graphics memory. Planning against total VRAM can turn a model that looks safe into a load failure or an eviction loop.

Lizard asks the driver what is available now, then budgets model weights and runtime needs against that live figure. If the fit is unsafe, it chooses a supported path and reports why.

Capacity planning should begin with free memory, not advertised memory.

Engineering fact: Lizard checks the graphics driver's currently available memory rather than assuming the GPU's advertised total is free.

Read the relevant Lizard page

#VRAM #GPUEngineering #LocalAI #LizardLLM #InferenceEngineering

<!-- lizard-marketing-slot:day-02-am -->