What Caterpillar is, and why there are two engines
-
Caterpillar is the newer of Lizard's two engines. It exists because a gaming PC and a work laptop need genuinely different approaches to run the same model well.
Where lizard-native leans on your graphics card, Caterpillar is built to get the most out of:
- your processor, when there's no dedicated card, and
- shared/built-in graphics, where memory is tight.
Lizard picks it automatically — you never choose. It takes over when there's no discrete GPU, or when the model is too large to sit on the one you have.
It's also where most active development happens right now. Recent work made CPU decoding meaningfully faster and cut how much memory it reads for each word it generates.
More detail: https://lizard-llm.qendryx.com/product.html
If you're on a laptop with no dedicated card, this is the engine you're using — how does it feel?
Hello! It looks like you're interested in this conversation, but you don't have an account yet.
Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.
With your input, this post could be even better 💗
Register Login