kamu-data / kamu-cli

Next-generation decentralized data lakehouse and a multi-party stream processing network
https://kamu.dev
Other
301 stars 13 forks source link

CKAN examples #33

Open JvD007 opened 3 years ago

JvD007 commented 3 years ago

Are there some examples around the CKAN.API

For example I like to use this opendata set:

https://ckan.dataplatform.nl/dataset/speeltoestellen/resource/a8e4bb02-f072-424a-8663-5a5f0fe7c7c0

API call: https://ckan.dataplatform.nl/api/3/action/datastore_search?resource_id=a8e4bb02-f072-424a-8663-5a5f0fe7c7c0&limit=5

on this platform we have 1900 opendata sources, will be nice to have one example in github

Let me know

sergiimk commented 3 years ago

Hi @JvD007,

CKAN is probably the most widespread Open Data platform out there, so we definitely want to make kamu as easy to use with CKAN as possible.

So far we were assuming that people could use the bulk CSV download URLs from CKAN when ingesting data, so in your dataset this would be:

https://ckan.dataplatform.nl/dataset/69743b8c-86b4-4eda-9d30-6d80109c0628/resource/a8e4bb02-f072-424a-8663-5a5f0fe7c7c0/download/speeltoestellen.csv

Is there a case you see where it is preferable to access data via query API instead of the bulk download?