Which model should I pick?
-
The honest answer: start with what setup recommends, then move up only if your machine looks bored.
Rough guide by memory:
RAM Sensible starting point 8 GB 1–3B model, Q4 16 GB 3–8B model, Q4 32 GB+ 8B and above, Q4–Q6 What the Q number means: compression. Q4 is roughly a quarter the size of the original with quality most people can't distinguish in normal use. Lower numbers are smaller and noticeably worse; higher are bigger and only marginally better. Q4 is the sweet spot and it's why it's the default.
Bigger is not automatically better — a 3B model that fits comfortably will feel far better to use than an 8B one that makes your machine swap.
What did setup suggest for you, and did you stick with it?
Hello! It looks like you're interested in this conversation, but you don't have an account yet.
Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.
With your input, this post could be even better 💗
Register Login