Skip to content

Commit

Permalink
[[Misc]] Add extra deps for openai server image (vllm-project#8792)
Browse files Browse the repository at this point in the history
  • Loading branch information
jeejeelee authored and liuyanyi committed Oct 6, 2024
1 parent 84429dc commit bd15e5b
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -202,7 +202,7 @@ FROM vllm-base AS vllm-openai

# install additional dependencies for openai api server
RUN --mount=type=cache,target=/root/.cache/pip \
pip install accelerate hf_transfer 'modelscope!=1.15.0'
pip install accelerate hf_transfer 'modelscope!=1.15.0' bitsandbytes>=0.44.0 timm==0.9.10

ENV VLLM_USAGE_SOURCE production-docker-image

Expand Down

0 comments on commit bd15e5b

Please sign in to comment.