How to create custom image with transformers pre-installed?

ELS-RD / transformer-deploy

Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀

https://els-rd.github.io/transformer-deploy/

Apache License 2.0

1.64k stars 150 forks source link

How to create custom image with transformers pre-installed? #147

Closed tamaghna-dutta closed 1 year ago

tamaghna-dutta commented 1 year ago

To create your own custom image:

[Dockerfile] FROM nvcr.io/nvidia/tritonserver:22.07-py3 ADD ./requirements.txt requirements.txt RUN pip install -r requirements.txt CMD ["/bin/bash", "-c", "tritonserver --model-repository=/models"]