This PR adds some integration tests for the following Hugging Face DLCs on Google Cloud:
TGI only on GPU
TEI on both CPU and GPU
PyTorch Inference on both CPU and GPU
PyTorch Training only on GPU
The tests related to the inference try different alternatives, as well as emulate the Vertex AI environments via the AIP_ environment variables exposed by Vertex AI and handled within the Hugging Face DLCs on Google Cloud for a seamless integration.
Description
This PR adds some integration tests for the following Hugging Face DLCs on Google Cloud:
The tests related to the inference try different alternatives, as well as emulate the Vertex AI environments via the
AIP_environment variables exposed by Vertex AI and handled within the Hugging Face DLCs on Google Cloud for a seamless integration.