Epic: Port GitHub API optimization to Bitbucket Cloud

renovatebot / renovate

Home of the Renovate CLI: Cross-platform Dependency Automation by Mend.io

https://mend.io/renovate

GNU Affero General Public License v3.0

16.78k stars 2.19k forks source link

Epic: Port GitHub API optimization to Bitbucket Cloud #27801

Open rarkins opened 5 months ago

rarkins commented 5 months ago

Describe the proposed change(s).

We have focused on github API optimization recently and need to port as much as possible to Bitbucket Cloud due to its low rate limits. This is an "epic" issue which should contain a sub-issue for each identified optimization which can be done.

zharinov commented 4 months ago

We've discovered that ETag-based caching doesn't help us to avoid rate limits, therefore it seems to be useless

rarkins commented 4 months ago

How about PR list intelligent caching, so that we fetch only the first page each run?

zharinov commented 4 months ago

I believe we already have it for Bitbucket

rarkins commented 4 months ago

@zharinov please try for Bitbucket Cloud:

Cold cache run
Hot cache run (immediately after)
Warm cache run (e.g. with cache, but after some time or after modifications to e.g. issues or PRs)

And check if our API use is as optimal as it can be. Bitbucket Cloud has the lowest rate limits of all so we should consider aggressively caching some endpoints if feasible as the trade-off may be worth it.