huggingface / Google-Cloud-Containers

Hugging Face Deep Learning Containers (DLCs) for Google Cloud
https://hf.co/docs/google-cloud
Apache License 2.0
130 stars 18 forks source link

[DOCUMENTATION] Extend information about Hugging Face PyTorch DLCs for Inference #78

Open alvarobartt opened 2 months ago

alvarobartt commented 2 months ago

Description

The Hugging Face PyTorch DLCs for Inference support a wide variety of tasks and so on, both the I/O payloads differ depending on which HF_TASK value is set. So on, the README.md should be extended at least to mention the available environment variables, and add some pointers to the I/O payloads for those.

Additionally, within the hf.co/docs/google-cloud (once published) we could add a section on how to run inference on all the supported scenarios, as right now the documentation on that is limited to the existing examples which may not cover every single use case.