search

open-contracting / kingfisher-collect

Downloads OCDS data and stores it on disk
https://kingfisher-collect.readthedocs.io
BSD 3-Clause "New" or "Revised" License
13 stars 12 forks source link

moldova: High error rate (2024-04) #1083

Open jpmckinney opened 7 months ago

jpmckinney commented 7 months ago

From #1056

35k missing contracting processes is a lot

Currently seeing a lot of these (from my own computer):

{"message":"socket hang up","name":"Error","stack":"Error: socket hang up\n    at connResetException (internal/errors.js:609:14)\n    at TLSSocket.socketOnEnd (_http_client.js:453:23)\n    at TLSSocket.emit (events.js:327:22)\n    at endReadableNT (_stream_readable.js:1221:12)\n    at processTicksAndRejections (internal/process/task_queues.js:84:21)","config":{"url":"https://mtender.gov.md/search/complaints?NrProcedurii=ocds-b3wdp1-MD-1713426631402&page=1","method":"get","headers":{"Accept":"application/json, text/plain, */*","User-Agent":"axios/0.21.1"},"transformRequest":[null],"transformResponse":[null],"timeout":0,"xsrfCookieName":"XSRF-TOKEN","xsrfHeaderName":"X-XSRF-TOKEN","maxContentLength":-1,"maxBodyLength":-1},"code":"ECONNRESET"}

Not a single item was yielded during the 3.5 hour crawl (before being cancelled)

https://collect.data.open-contracting.org/logs/kingfisher/moldova/0dfbccde03d911efaf9aa8a159689b50.log

jpmckinney commented 7 months ago

Duplicate #1084

jpmckinney commented 4 weeks ago

Already frozen in registry (not sure when, but no jobs since Jan 2024)

yolile commented 3 weeks ago

Already frozen in registry (not sure when, but no jobs since Jan 2024)

Since April 2024 https://github.com/open-contracting/kingfisher-collect/issues/1084#issuecomment-2079852677