New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Move attention mask to device in web ui demo #70

Open

shixianc wants to merge 2 commits into QwenLM:main from shixianc:main

+3 −2

shixianc commented Sep 16, 2024

Move attention_mask of inputs to device as well, otherwise it will complain device not matching, if loading model to devices. Probably some changes in the model class in transformers, not sure why it's previous working.
Upgrade gradio version to 4.44.0 because in the requirements_web_demo.txt does not work. This was mentioned in issue please update requirements_web_demo.txt,the old version of gradio raise error:__get_pydantic_core_schema__ #67

shixian added 2 commits

September 16, 2024 05:10


          Move attention mask to device in web ui demo

9836d2e


          Upgrade gradio to 4.44.0 to avoid pydantic error

b9744b1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet