Occasional HTTP 504 error

foojayio / discoapi

The foojay discovery api (discoapi) is made to discover java packages (jre/jdk) from different distributions.

GNU General Public License v2.0

111 stars 13 forks source link

Occasional HTTP 504 error #45

Closed marchof closed 2 years ago

marchof commented 2 years ago

I run a nightly CI build to sync javaalmanac.io data with disco API (basically to find out whether a certain distro is available on the disco API)

Almost every night (at 01:00 UTC) the following query fails:

java.io.IOException: Server returned HTTP response code: 504 for URL: https://api.foojay.io/disco/v2.0/packages?version=11&distro=semeru&latest=available

If I trigger the build again in the morning it works again.

HanSolo commented 2 years ago

Yep I also see this and we are working on that to fix it asap

marchof commented 2 years ago

This happens every night now. Manual re-build in the morning works. Am I colliding with some scheduled deployment on your side? Should I schedule my update job for a different time? Thx!

HanSolo commented 2 years ago

We've changed something in the infrastructure which gives us some trouble at the moment. We are working on that and I hope we will be able to fix it today. It should not be a problem when you trigger the api over night, the problem is on our side.

marchof commented 2 years ago

Thanks for the udate. Keeping fingers crossed for you to get it up and running again!

HanSolo commented 2 years ago

Should be fixed in the meantime

marchof commented 2 years ago

I can confirm! Thx.

marchof commented 2 years ago

504 is back since tonight:

java.io.IOException: Server returned HTTP response code: 504 for URL: https://api.foojay.io/disco/v2.0/packages?version=15&distro=zulu&latest=available

HanSolo commented 2 years ago

Yep I saw that too, was your call around 11:30pm?

marchof commented 2 years ago

Had two failures so far:

Nov 09, 2021 2:02:44 AM
Nov 09, 2021 10:04:31 AM

I guess GitHub action tiestamps are in UTC.

HanSolo commented 2 years ago

Hmm...ok...good to know...thx a lot 👍🏻

marchof commented 2 years ago

Still getting random 400, 502 and 504 responses. Examples:

Fri, 12 Nov 2021 02:03:03 GMT java.io.IOException: Server returned HTTP response code: 502 for URL: https://api.foojay.io/disco/v2.0/packages?version=11&distro=temurin&latest=available
Fri, 12 Nov 2021 09:40:40 GMT java.io.IOException: Server returned HTTP response code: 400 for URL: https://api.foojay.io/disco/v2.0/packages?version=10&distro=sap_machine&latest=available
Fri, 12 Nov 2021 09:44:15 GMT java.io.IOException: Server returned HTTP response code: 504 for URL: https://api.foojay.io/disco/v2.0/packages?version=11&distro=dragonwell&latest=available

HanSolo commented 2 years ago

Made some changes over the weekend, would be great if you could check again if the problem still exists.

marchof commented 2 years ago

Indeed, build was green tonight, thx! I'll keep an eye on it.