<![CDATA[Which model should I pick?]]>The honest answer: start with what setup recommends, then move up only if your machine looks bored.

Rough guide by memory:

RAM Sensible starting point
8 GB 1–3B model, Q4
16 GB 3–8B model, Q4
32 GB+ 8B and above, Q4–Q6

What the Q number means: compression. Q4 is roughly a quarter the size of the original with quality most people can't distinguish in normal use. Lower numbers are smaller and noticeably worse; higher are bigger and only marginally better. Q4 is the sweet spot and it's why it's the default.

Bigger is not automatically better — a 3B model that fits comfortably will feel far better to use than an 8B one that makes your machine swap.

What did setup suggest for you, and did you stick with it?

]]>https://community.lizard-llm.qendryx.com/topic/18/which-model-should-i-pickRSS for NodeMon, 24 Aug 2026 01:37:29 GMTWed, 15 Jul 2026 10:42:00 GMT60