open-contracting / kingfisher-collect

Downloads OCDS data and stores it on disk
https://kingfisher-collect.readthedocs.io
BSD 3-Clause "New" or "Revised" License
13 stars 12 forks source link

Add CDL Assam spider #1060

Closed ndrhzn closed 5 months ago

ndrhzn commented 5 months ago

While CDL presents OCDS data at https://assam.open-contracting.in/datasets, actual datasets (OCDS package & flattened data) are stored on GitHub

Links to bulk download and/or API documentation https://github.com/CivicDataLab/assam-tenders-data/tree/main/data

Links to bulk download and/or API endpoints https://github.com/CivicDataLab/assam-tenders-data/blob/main/data/ProcessedData/ocds-mapped-data/current/ocds_mapped_data.json.zip

Priority anytime

Data structure Data has been checked using DRT (and DRT was able to process it)

Publication format Data is provided as an archive that contains package.json file with compiled releases packaged.

yolile commented 5 months ago

@ndrhzn do they share the link to the GitHub repo somewhere in their website? The only other link I could find in their website was one to a Google Drive file: image

yolile commented 5 months ago

Never mind, I see now that the Download button redirects to the GitHub file 👍🏻

yolile commented 5 months ago

@ndrhzn deployed, see https://kingfisher-collect.readthedocs.io/en/latest/spiders.html#kingfisher_scrapy.spiders.india_assam_civic_data_lab.IndiaAssamCivicDataLab