Add Llama 3.2 Visual example on both GKE and Vertex AI

huggingface / Google-Cloud-Containers

Hugging Face Deep Learning Containers (DLCs) for Google Cloud

https://hf.co/docs/google-cloud

Apache License 2.0

130 stars 18 forks source link

Add Llama 3.2 Visual example on both GKE and Vertex AI #106

Closed alvarobartt closed 1 month ago

alvarobartt commented 1 month ago

Description

This PR adds an example on how to deploy meta-llama/Llama-3.2-11B-Vision-Instruct in both Vertex AI and GKE.

[!NOTE] This PR should be merged once the latest TGI DLC is released, ideally right after #102 since that PR also contains some other updates and fixes related to the documentation and the example listings.