Currently our github api derived assets, ossd__repositories and ossd__sbom, use the same underlying retry logic. It would also be useful if that same retry logic logged to dagster when the rate limit is reached.
Describe the solution you'd like
Have a log that appears in the UI when the rate limit condition is met and the process is idling due to the rate limit.
Describe the feature you'd like to request
Currently our github api derived assets,
ossd__repositories
andossd__sbom
, use the same underlying retry logic. It would also be useful if that same retry logic logged to dagster when the rate limit is reached.Describe the solution you'd like
Have a log that appears in the UI when the rate limit condition is met and the process is idling due to the rate limit.
Describe alternatives you've considered
N/A