huggingface / Google-Cloud-Containers

Including Hugging Face Deep learning Containers for Google Cloud
Apache License 2.0
112 stars 10 forks source link

Patch `huggingface_inference_toolkit` wheel and update PyTorch Inference containers #63

Closed alvarobartt closed 1 month ago

alvarobartt commented 1 month ago

Description

This PR updates the huggingface_inference_toolkit wheel (we're using a wheel since the package is not publicly released yet i.e. not in PyPI), since as reported by Google, the artifact download from Google Cloud Storage (GCS) via the AIP_STORAGE_URI environment variable was not working.

So on, that issue was fixed at https://github.com/huggingface/huggingface-inference-toolkit/pull/76; and besides that we also included the google extra within huggingface_inference_toolkit so that the google-cloud-storage installation (and any other required package in the future) is installed via the extras, see https://github.com/huggingface/huggingface-inference-toolkit/pull/77.

Finally, this PR also updates the Dockerfile images so as to install the extras from the wheel instead of installing the dependencies and then the wheel, so that the dependency management is defined within huggingface_inference_toolkit instead.