search

CrossRef / rest-api-doc

Documentation for Crossref's REST API. For questions or suggestions, see https://community.crossref.org/
Other
721 stars 270 forks source link

Sporadic 504 Gateway Time-out #572

Open michael-newsrx opened 2 years ago

michael-newsrx commented 2 years ago

I keep getting sporadic 504 error responses with URLs like the following.

https://api.crossref.org/works?mailto=user1%40newsrx.com%2Cuser2%40newsrx.com%2Cuser3%40newsrx.com%2Cuser4%40newsrx.com&filter=type%3Ajournal-article%2Cfrom-index-date%3A2022-04-26%2Cuntil-index-date%3A2022-04-26%2Cfrom-issued-date%3A2021-01-01%2Cfrom-issued-date%3A2021-01-01%2Cuntil-issued-date%3A2021-01-31&sort=issued&rows=1&cursor=*

michael-newsrx commented 2 years ago

It seems that this is usually accompanied by a drop in records indexed for a specific day and published date range.

(TIMESTAMP) INDEXED_DATE [ISSUED_FROM...ISSUED_UNTIL]: RESULT_COUNT

(2022-04-28T11:25:13) 2022-04-26 [2021-12-01...2021-12-31]: 3,986

[0] IOException.
Sleeping 30 seconds.
(2022-04-28T11:26:52) 2022-04-26 [2021-12-01...2021-12-31]: 3,985 

[1] IOException.
Sleeping 60 seconds.
(2022-04-28T11:28:55) 2022-04-26 [2021-12-01...2021-12-31]: 3,984 

[2] IOException.
Sleeping 90 seconds.
(2022-04-28T11:30:42) 2022-04-26 [2021-12-01...2021-12-31]: 3,983

[3] IOException.
Sleeping 120 seconds.
ppolischuk commented 2 years ago

Likely to do with this ongoing incident: https://status.crossref.org/incidents/8jl8fq75sncx

jazbinzy commented 6 months ago

Getting 504 Gateway Time-out while deposit metadata using https://api.crossref.org/v2/deposits