New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

how to use in ollama? #131

Open

NeverBeLazyG opened this issue Oct 11, 2024 · 3 comments

Labels

stale

NeverBeLazyG commented Oct 11, 2024

hello,

how can i use this models in ollama, can you give me some tutorial link or somthing ?

thank you

Collaborator

BlackSamorez commented Oct 11, 2024

Hi! AQLM only works with transformers and vLLM. No ollama support (and no such plans).

Author

NeverBeLazyG commented Oct 13, 2024

really bad. thank you

github-actions bot commented Nov 13, 2024

This issue is stale because it has been open for 30 days with no activity.

github-actions bot added the stale label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment