Lizard inference engineering: Use UMA without a fake copy
-
Inference Engineering · Day 6 · Evening
An integrated GPU is not a small discrete GPU.
On unified-memory hardware, CPU and GPU already access the same physical memory. Treating that system like a discrete card can add unnecessary staging and copies.
lizard-native includes a UMA zero-copy path for supported integrated graphics. The design goal is simple: shared weights should stay shared, while the Direct3D 12 execution path remains explicit.
Hardware-aware inference starts by respecting the memory architecture you actually have.
Engineering fact: lizard-native includes a zero-copy path for unified-memory integrated GPUs so shared memory is treated as shared rather than copied as if discrete.
#LizardNative #IntegratedGPU #D3D12 #ZeroCopy #LocalAI
<!-- lizard-marketing-slot:day-06-pm -->
Hello! It looks like you're interested in this conversation, but you don't have an account yet.
Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.
With your input, this post could be even better 💗
Register Login