Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀
1.64k
stars
150
forks
source link
How to create custom image with transformers pre-installed? #147
Closed
tamaghna-dutta closed 1 year ago
To create your own custom image:
[Dockerfile] FROM nvcr.io/nvidia/tritonserver:22.07-py3 ADD ./requirements.txt requirements.txt RUN pip install -r requirements.txt CMD ["/bin/bash", "-c", "tritonserver --model-repository=/models"]