A fixed concurrency default ignores both hardware capacity and measured behavior.

Lizard treats B=16 as the throughput target and B=8 as the normal reduced-capacity lane. When both have completed HTTP evidence, the faster eligible primary lane wins. B=4 and B=1 are reserved for constrained fallback.

The policy turns a benchmark result into a serving decision without pretending every machine has the same memory budget.

Would your runtime choose the same batch lane on an integrated GPU and a discrete GPU?

Engineering fact: Lizard's adaptive concurrency policy chooses the faster completed B=16 or B=8 HTTP measurement when capacity permits; B=4 and B=1 remain fallbacks.

Read the relevant Lizard page

#LizardNative #LizardLLM #LocalAI #GGUF #InferenceEngineering

<!-- lizard-marketing-slot:day-14-am -->