Use predict_vllm function for prediction.

GoogleCloudPlatform / vertex-ai-samples

Notebooks, code samples, sample apps, and other resources that demonstrate how to use, develop and manage machine learning and generative AI workflows using Google Cloud Vertex AI.

https://cloud.google.com/vertex-ai

Apache License 2.0

117 stars 28 forks source link

Use predict_vllm function for prediction. #3535

Open copybara-service[bot] opened 2 months ago

copybara-service[bot] commented 2 months ago

Use predict_vllm function for prediction.

review-notebook-app[bot] commented 2 months ago

Check out this pull request on

See visual diffs & provide feedback on Jupyter Notebooks.