Add optimized vLLM to Llama 3.1 deployment notebook.

GoogleCloudPlatform / vertex-ai-samples

Notebooks, code samples, sample apps, and other resources that demonstrate how to use, develop and manage machine learning and generative AI workflows using Google Cloud Vertex AI.

https://cloud.google.com/vertex-ai

Apache License 2.0

103 stars 25 forks source link

Add optimized vLLM to Llama 3.1 deployment notebook. #3681

Closed copybara-service[bot] closed 3 weeks ago

copybara-service[bot] commented 3 weeks ago

Add optimized vLLM to Llama 3.1 deployment notebook.

review-notebook-app[bot] commented 3 weeks ago

Check out this pull request on

See visual diffs & provide feedback on Jupyter Notebooks.