GoogleCloudPlatform / vertex-ai-samples

Notebooks, code samples, sample apps, and other resources that demonstrate how to use, develop and manage machine learning and generative AI workflows using Google Cloud Vertex AI.
https://cloud.google.com/vertex-ai
Apache License 2.0
103 stars 25 forks source link

Added notebook titled "backoff_and_retry_for_LLMs.ipynb" to the /notebooks/community/generative_ai/ directory #3706

Closed pemujo closed 1 week ago

pemujo commented 1 week ago

Summary: I added a new notebook titled "backoff_and_retry_for_LLMs.ipynb" to the /notebooks/community/generative_ai/ directory.
This notebook demonstrates how to trigger and handle 429 Quota exceeded errors using backoff and retry strategies with Dynamic shared quota. The notebook includes the accompanying code for an upcoming blog post on the same topic.


PR is for Community Notebooks under the notebooks/community folder:


review-notebook-app[bot] commented 1 week ago

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

gericdong commented 1 week ago

@pemujo Looks good. Please fix the linter errors