We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
LocalAI version: v2.17.1
Environment, CPU architecture, OS, and Version: Linux desktop 6.9.5-arch1-1 #1 SMP PREEMPT_DYNAMIC Sun, 16 Jun 2024 19:06:37 +0000 x86_64 GNU/Linux Archlinux
Describe the bug The RPC worker crashes
To Reproduce
sudo wget https://github.com/mudler/LocalAI/releases/download/v2.17.1/local-ai-Linux-x86_64 -O /usr/bin/localai sudo chmod +x /usr/bin/localai /usr/bin/localai worker llama-cpp-rpc --debug --
Expected behavior Runs without crash.
Logs
➜ ~ /usr/bin/localai worker llama-cpp-rpc --debug -- 9:45AM DBG Setting logging to debug 9:45AM DBG Extracting backend assets files to /tmp/localai/backend_data *** stack smashing detected ***: terminated [1] 8658 IOT instruction (core dumped) localai worker llama-cpp-rpc --debug -- ➜ ~
Additional context
The text was updated successfully, but these errors were encountered:
@JamesClarke7283 it's only the worker right?
can you confirm if you start the normal HTTP server inference works?
Sorry, something went wrong.
@JamesClarke7283 it's only the worker right? can you confirm if you start the normal HTTP server inference works?
yes, running localai normally works fine.
Thanks, when will a release happen including this fix? I prefer the binary builds rather than building myself.
Successfully merging a pull request may close this issue.
LocalAI version:
v2.17.1
Environment, CPU architecture, OS, and Version:
Linux desktop 6.9.5-arch1-1 #1 SMP PREEMPT_DYNAMIC Sun, 16 Jun 2024 19:06:37 +0000 x86_64 GNU/Linux
Archlinux
Describe the bug
The RPC worker crashes
To Reproduce
Expected behavior
Runs without crash.
Logs
Additional context
The text was updated successfully, but these errors were encountered: