Getting NVidia GPU to work on linux #486
JustPlaneTastic
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I've installed Lollms-webgui two or three times now and I have a set of symptom that continue across each install. Text generation is only making use to the CPU for processing. It doesn't seem to matter which binding I use, whether Nvida is chosen, GPU is chosen, or Tensors are chosen (depending on binding support). The farthest I can seem to get in the process is for GPU to be recognized and for VRAM to be utilized (see screenshot).
Is there something you all have to do to trigger the compute to move to the GPU?
Thanks for any feedback
Beta Was this translation helpful? Give feedback.
All reactions