search

simonw / scrape-open-data

Scrape various open data directories to create an index of what's available out there
https://open-data.datasette.io
28 stars 2 forks source link

CKAN support #5

Open simonw opened 2 years ago

simonw commented 2 years ago

CKAN is the biggest alternative to Socrata that I know of: https://ckan.org/government

It powers the Data.gov API: https://data.gov/developers/apis/index.html - documentation here: https://docs.ckan.org/en/latest/api/

simonw commented 2 years ago

https://catalog.data.gov/api/3/action/package_search (which is redirected to from package_list) shows 346,434 results, returning 10 per page.

https://catalog.data.gov/api/3/action/package_search?rows=1000 returns 1,000 pages - full docs for that method are here (it's powered by Solr): https://docs.ckan.org/en/latest/api/#ckan.logic.action.get.package_search

https://catalog.data.gov/api/3/action/recently_changed_packages_activity_list returns "an activity stream of recently changed datasets on a site".