We implemented an AVX-512 VNNI decode kernel and chose not to enable it by default.

The instruction is promising on supported Intel and AMD CPUs. But on the hardware available for validation, the measured result remained inside ordinary run-to-run noise.

Caterpillar ships the proven path as default and keeps VNNI behind an explicit experiment flag.

Engineering credibility sometimes means declining to claim a speedup.

Engineering fact: Caterpillar's AVX-512 VNNI kernel remains opt-in because it measured within normal run-to-run noise on available test hardware.

Read the relevant Lizard page

#AVX512 #CPUOptimization #Benchmarking #CaterpillarEngine #LizardLLM

<!-- lizard-marketing-slot:day-07-pm -->