Lizard inference engineering: Choose the next benchmark with us
-
Inference Engineering · Day 10 · Evening
Ten days of inference engineering ends with the most important benchmark input: your question.
Our published results belong to the hardware, model, quantization, prompt and token budget shown. They identify real bottlenecks; they do not create a universal provider ranking.
What should we test next?
Please include your CPU/GPU, available memory, model, quantization and the decision you need the benchmark to answer.
Engineering fact: Published Lizard results are model-, quantization-, prompt-, hardware-, and run-specific; the next useful test should be selected with that context.
#Benchmarking #LocalAI #InferenceEngineering #LizardNative #CaterpillarEngine
<!-- lizard-marketing-slot:day-10-pm -->
Hello! It looks like you're interested in this conversation, but you don't have an account yet.
Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.
With your input, this post could be even better 💗
Register Login