Feature requests for opendata.riik.ee

timotoots commented 6 years ago

I heard we could talk about the future of open data portal here as well.

I wish the open data portal would also handle quality control. I am working on a project involving a lot of different data sources in real time, so the quality and consistency becomes important. I think these features might be important for many projects and make developing new ones easier.

API for open data providers and their provided files or APIs.
It would be nice to know more about the actual files provided. Like last updated time, size, exact format. Same goes to APIs - which queries are possible.
To provide consistency, it is important to know if the data format or API isn't changed. There could be bots downloading and checking the data for each update. If the CSV file doesn't match the column count of the last one, raise red flag.
Data provider's server downtime checker. Useful info for building real-time apps.
Maybe a long-term idea, but it might be nice to have an API gateway for all the open data available. It would be one place that would handle all quality control, version control, formatting, different output formats, documentation, API browser etc and make it easy to build apps on top of the data.

Just some ideas..

keeganmcbride commented 6 years ago

Hi Timo,

Can you explain your use case in a bit more detail so I can see what can be done? I agree with many of these suggestions, but will take further investigation.

timotoots commented 6 years ago

I am building an art installation that combines different data sources and creates a view of this data from a perspective of local geographical regions (villages, cities etc). So it's like a real-time data display about each village and city in Estonia. The installation will be permanent, it means it has to endure the changes in data structures. And it would be good to include new data sources when they are made available. Would be nice to have a data newsletter to announce new data providers every month : )

timotoots commented 6 years ago

I have looked into CKAN and it seems the software package actually supports many features. There are DataStore and DataPusher extensions that would enable making an API Gateway for all available open data.

Are there any plans to work on these topics?

infokujur commented 5 years ago

Features for portal can be asked here: https://github.com/okestonia/jkan/issues We do have grooming process happening where we evaluate new feature requests. @keeganmcbride - can you direct @timotoots if there are anything resolved already?

infokujur commented 5 years ago

And please open issues in this repo after: https://github.com/okestonia/jkan/issues and close this one here.

okestonia / opendata-issue-tracker

Feature requests for opendata.riik.ee #91