search

databricks / cli

Databricks CLI
Other
132 stars 50 forks source link

Fetching latest releases in `databricks labs ...` sometimes fails with `refresh: github request failed: 403 Forbidden` #1633

Open nfx opened 2 months ago

nfx commented 2 months ago

Describe the issue

Fetching latest releases for a repo sometimes fails with 403 error due to rate limits

databricks labs ucx migrate-credentials --aws-profile aws-sandbox-field-eng_databricks-sandbox-admin --profile sandbox_fed --debug
17:33:30  INFO start pid=95664 version=0.224.1 args="databricks, labs, ucx, migrate-credentials, --aws-profile, aws-sandbox-field-eng_databricks-sandbox-admin, --profile, sandbox_fed, --debug"
17:33:30 DEBUG Fetching latest releases for databrickslabs/ucx from GitHub API pid=95664
Error: refresh: github request failed: 403 Forbidden
17:33:31 ERROR failed execution pid=95664 exit_code=1 error="refresh: github request failed: 403 Forbidden"

Steps to reproduce the behavior

  1. Make 5000+ anonymous GitHub API calls from a single IP address within an hour
  2. databricks labs install ucx

Expected Behavior

CLI doesn't fail, continue executing

Actual Behavior

CLI fails