Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can this handle classification models, e.g. MNLI? #12

Open
redthing1 opened this issue Jun 5, 2023 · 3 comments
Open

Can this handle classification models, e.g. MNLI? #12

redthing1 opened this issue Jun 5, 2023 · 3 comments

Comments

@redthing1
Copy link

For example, a model like this:
https://huggingface.co/aloxatel/bert-base-mnli

If so, how would I do inference on it?

@skeskinen
Copy link
Owner

@okpatil4u implemented classification here #11
I don't know if they ever made the changes public

@yilong2001
Copy link

@okpatil4u implemented classification here #11 I don't know if they ever made the changes public

Here is the bert classification model with ggml: https://github.com/yilong2001/berts.cpp

@redthing1
Copy link
Author

@okpatil4u implemented classification here #11 I don't know if they ever made the changes public

Here is the bert classification model with ggml: yilong2001/berts.cpp

Excellent, thank you! Could you share with me briefly any instructions to try it?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants