opensource-observer / oso

Measuring the impact of open source software
https://opensource.observer
Apache License 2.0
73 stars 16 forks source link

Add rate limit logging to the github api derived assets #2416

Open ravenac95 opened 3 weeks ago

ravenac95 commented 3 weeks ago

Describe the feature you'd like to request

Currently our github api derived assets, ossd__repositories and ossd__sbom, use the same underlying retry logic. It would also be useful if that same retry logic logged to dagster when the rate limit is reached.

Describe the solution you'd like

Have a log that appears in the UI when the rate limit condition is met and the process is idling due to the rate limit.

Describe alternatives you've considered

N/A