Handling the progress bar for VLLM #26626
JamshidJDMY
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Checked
Feature request
When I am using VLLM using langchain, it shows a progress bar for each input. I read the code of VLLM and Langchain (link) on GitHub and I understood that in line 133, there is parameter called use_tqdm that should be False to disable it but there is no option to disable it using Langchain. Add a new parameters to handle it.
Motivation
My motivation is that enable/disable of progress bar should be optional because it affect on the appearance of applications.
Proposal (If applicable)
No response
Beta Was this translation helpful? Give feedback.
All reactions