Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
GPTQ Env vars: catch correct type of error (#596)
# What does this PR do? When passing in environment variables like gptq_bits, we still get errors thrown from TGI because the try/catch block is catching the wrong type of error. This PR aims to fix that. @Narsil - let me know if this is how you want this formatted. My Python is a little shaky, so I hope this syntax is correct.
- Loading branch information