v1.4-djl-0.27.0-inf-trt-0.8.0
For details on the complete list of DLCs, please visit the AWS documentation page: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html
Images Published:
763104351884.dkr.ecr.us-west-2.amazonaws.com/djl-inference:0.27.0-tensorrtllm0.8.0-cu122-v1.4
sha256:bfaba75d914259ce8dbd366ad61962c0adae3f938b44b488054441c98ee845d3
All tags:
0.27-tensorrtllm0.8.0-cu122-v1
0.27.0-tensorrtllm0.8.0-cu122
0.27.0-tensorrtllm0.8.0-cu122-v1.4-2024-05-13-16-55-36
0.27.0-tensorrtllm0.8.0-cu122-v1.4
Important Packages:
| pip packages | apt|deb packages |
|---|---|
| PyYAML==6.0.1 | cuda-command-line-tools-12-2 |
| awscli==1.32.101 | libcublas-12-2 & libcublas-dev-12-2 |
| botocore==1.34.101 | libcudnn8 & libcudnn8-dev |
| Cython==3.0.10 | libgcc-11-dev:amd64 & libgcc-s1:amd64 |
| datasets==2.19.1 | libgcc-11-dev:amd64 & libgcc-s1:amd64 |
| filelock==3.14.0 | libnccl-dev & libnccl2 |
| mpi4py==3.1.6 | libnccl-dev |
| ninja==1.11.1.1 | libstdc++-11-dev:amd64 & libstdc++6:amd64 |
| numpy==1.26.4 | |
| packaging==24.0 | |
| pandas==2.2.2 | |
| pillow==10.3.0 | |
| protobuf==5.26.1 | |
| regex==2024.4.28 | |
| requests==2.31.0 | |
| s3transfer==0.10.1 | |
| scipy==1.13.0 | |
| sentencepiece==0.2.0 | |
| setuptools==69.5.1 | |
| tokenizers==0.15.2 | |
| torch==2.1.2 | |
| torchvision==0.16.2 | |
| transformers==4.38.1 |