Support deploying Hex-LLM on multi-hosts TPU, like v5e-16.

GoogleCloudPlatform / vertex-ai-samples

Notebooks, code samples, sample apps, and other resources that demonstrate how to use, develop and manage machine learning and generative AI workflows using Google Cloud Vertex AI.

https://cloud.google.com/vertex-ai

Apache License 2.0

115 stars 27 forks source link

Support deploying Hex-LLM on multi-hosts TPU, like v5e-16. #3553

Closed copybara-service[bot] closed 2 months ago

copybara-service[bot] commented 2 months ago

Support deploying Hex-LLM on multi-hosts TPU, like v5e-16.

review-notebook-app[bot] commented 2 months ago

Check out this pull request on

See visual diffs & provide feedback on Jupyter Notebooks.