This PR releases the new Hugging Face PyTorch DLC for Inference with a bunch of version dumps for transformers, diffusers and sentence-transformers; as well astorchand other dependencies that otherwise could be problematic as the latesthuggingface_hubrelease affectingdiffusers` <= 0.30.0
Some of the changes in this PR include:
Include missing requirements.txt installation in entrypoint.sh (required to install custom dependencies with custom models).
Fix uvicorn trigger on the entrypoint.sh to use exec so that the process runs with PID 1, allowing it to receive signals directly; and so on, to be gracefully shut down.
Fix Python 3.11 installation as it was not properly installed and Python 3.10 was used instead; also fix pip installation to install via get-pip.py.
Tested with some of the latest models that those bumped dependencies support as Gemma2, Llama3.2, StableDiffusion 3.5, and much more.
Description
This PR releases the new Hugging Face PyTorch DLC for Inference with a bunch of version dumps for
transformers
,diffusers
andsentence-transformers; as well as
torchand other dependencies that otherwise could be problematic as the latest
huggingface_hubrelease affecting
diffusers` <= 0.30.0Some of the changes in this PR include:
requirements.txt
installation inentrypoint.sh
(required to install custom dependencies with custom models).uvicorn
trigger on theentrypoint.sh
to useexec
so that the process runs with PID 1, allowing it to receive signals directly; and so on, to be gracefully shut down.pip
installation to install viaget-pip.py
.