search

open-contracting / kingfisher-collect

Downloads OCDS data and stores it on disk
https://kingfisher-collect.readthedocs.io
BSD 3-Clause "New" or "Revised" License
13 stars 12 forks source link

Enugu State new spider #852

Closed odscrachel closed 3 years ago

odscrachel commented 3 years ago

Links to bulk download https://dueprocess.en.gov.ng/ocds_report.php

Link to CRM issue CRM-7680

Priority anytime

Data structure Passes DRT

odscrachel commented 3 years ago

I'll close this issue as the bulk download is currently giving data for a different state, I'll reopen when this is fixed.

odscrachel commented 3 years ago

Bulk downloads now available here: https://dueprocess.en.gov.ng/ocds_report.php

Ravf95 commented 3 years ago

@yolile I think we can parse the list of files with a selector and then download them. It's the same case as #831 because the site uses DataTables too.

odscrachel commented 3 years ago

I tried to run this spider today using the following command

curl -n https://collect.kingfisher.open-contracting.org/schedule.json -d project=kingfisher -d spider=nigeria_enugu_state -d note="Started by Rachel" steps=check,compile

and got the following error

{"status": "error", "message": "spider 'nigeria_enugu_state' not found"}

jpmckinney commented 3 years ago

I've redeployed and run the command. The spider is now running.

Note that you're missing a -d before steps=check,compile - not sure if this is an error in documentation somewhere?

odscrachel commented 3 years ago

Great, thanks and not to worry, -d was my omission. Although as a side note, I don't think the check command is in the deploy docs yet.

jpmckinney commented 3 years ago

All good - we'll update the docs as part of #861