Look at ways of improving GitHub commit lookups

njh / arduino-libraries

A website listing all the available Arduino Libraries

https://www.arduinolibraries.info/

MIT License

54 stars 12 forks source link

Open njh opened 10 months ago

njh commented 10 months ago

One of the slowest parts / most requests to GitHub is looking up all the Git commit ids for the library versions.

njh commented 10 months ago

@per1234 do you think there is any chance of getting Arduino team to add the Git commit Ids to library_index.json.

So that they don't all need to be looked up again?

80avin commented 10 months ago

Few ideas which are working for me are

Support refresh instead cleaning up everything and re-downloading everytime.
- Further, save/cache the found tag so that it can be used in future refreshes.
- With etag, last-updated-at header, the requests made won't be counted in API quota
- set $tags[key] = [] before fetching. So that if github returns no tag or error (repo not found?), then we won't make request for other versions of same repo

I'll push a draft in a day or two to get reviews.