search

huggingface / Google-Cloud-Containers

Hugging Face Deep Learning Containers (DLCs) for Google Cloud
https://hf.co/docs/google-cloud
Apache License 2.0
127 stars 16 forks source link

Support serving models on stored on GCS and add LICENSE. #23

Closed dstnluong-google closed 3 months ago

dstnluong-google commented 8 months ago

Support serving models on stored on GCS and add LICENSE.

alvarobartt commented 3 months ago

Hi here @dstnluong-google closing this PR for the moment, since some TGI releases ago we already include a custom entrypoint.sh file that handles the downloads from GCS via the environment variable AIP_STORAGE_URI provided within the Vertex AI deployments.

See an example entrypoint.sh at https://github.com/huggingface/Google-Cloud-Containers/blob/main/containers/tgi/gpu/2.2.0/entrypoint.sh