GetDKAN / dkan

DKAN Open Data Portal
https://dkan.readthedocs.io/en/latest/index.html
GNU General Public License v2.0
373 stars 171 forks source link

Investigate ETL integration tools and requirements #311

Closed dafeder closed 7 years ago

dafeder commented 9 years ago

What would it take to be able to say DKAN integrates well with popular ETL tools? Look into the following:

Those are all open source tools. We should also look into:

How much difference is there between all of these in terms of what is needed for integration?

Community input appreciated!

andrewhoppin commented 9 years ago

Another ETL tool, this one from Microsoft, and used by City of Houston for 311 and other data:

"SSIS": https://msdn.microsoft.com/en-us/library/ms169917.aspx

dafeder commented 7 years ago

Closing this ticket for now. We did look into creating a "connector" for Safe FME and would still be open to doing this as part of a contract, but don't have any immediate plans. What we did do was create a python client for DKAN that can be loaded into Safe FME workflows. A proof of concept for this kind of integration can be found here: https://github.com/NuCivic/fme_dkan_apis_workflows