search

open-contracting / kingfisher-collect

Downloads OCDS data and stores it on disk
https://kingfisher-collect.readthedocs.io
BSD 3-Clause "New" or "Revised" License
13 stars 12 forks source link

argentina_buenos_aires: Incomplete JSON from server only #874

Closed jpmckinney closed 3 months ago

jpmckinney commented 2 years ago

To check:

curl https://cdn.buenosaires.gob.ar/datosabiertos/datasets/ministerio-de-economia-y-finanzas/buenos-aires-compras/buenos_aires_compras.json | tail

Also, I'm not sure that download_timeout or DOWNLOAD_FAIL_ON_DATALOSS are necessary. The download is fast and I don't think we want to be okay with data loss (though neither are triggered in this case - the remote file is just bad).

yolile commented 2 years ago

The URL is now https://cdn.buenosaires.gob.ar/datosabiertos/datasets/ministerio-de-economia-y-finanzas/buenos-aires-compras/bac_anual.json and it is working again

yolile commented 1 year ago

This is happening again now, but only in the server, not with curl

jpmckinney commented 1 year ago

Damn, their server is slow (200kbps for a 300M file). I'm testing but it takes like 30 mins each download.

jpmckinney commented 4 months ago

Logging that it is still occurring. The job now will fail in the registry, then try again next month.

yolile commented 3 months ago

It is working now

jpmckinney commented 3 months ago

Confirmed that registry had completed successfully and is not frozen.