What about adding OpenLLaMA support? #1406
Closed
Sovenok-Hacker
started this conversation in
Ideas
Replies: 1 comment 1 reply
-
You must have done something wrong, since it should just have worked. |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I think this is a very interesting model. The quality is a bit worse than the original LLaMA, but it can be used for commercial purposes. It took me about 2 hours to get it working with LLaMA.CPP. I used code from this gist to convert official files to GGML format and quantized it. It is a good and growing model. I think it would be good to add a guide on how to run it.
Beta Was this translation helpful? Give feedback.
All reactions