centraldedados / datacentral

Tools for generating portable data portals
58 stars 9 forks source link

Data Package download support #26

Closed loleg closed 7 years ago

loleg commented 7 years ago

In addition to supporting Git repositories, this PR proposes that Data Packages could be added to Datacentral simply by supplying the full URL in settings, e.g. a DataHub.io resource could be mirrored with:

londons-food-exports = https://datahub.io/dataset/londons-food-exports/datapackage.json

The package is then parsed, referenced files downloaded, and necessary adjustments made. Updates in the source data package are detected to avoid unnecessary refreshes.

We are using this new functionality at http://food.schoolofdata.ch

rlafuente commented 7 years ago

Oh my, this is wonderful! We're so happy to see this in action, the site looks great!

I'll set aside some time this week to review and merge -- sorry for the code mess! I can also join an IRC or other chat channel so I can maybe help on your next steps? Really excited to see this :v:

loleg commented 7 years ago

Many thanks @metaodi for this detailed review, and @rlafuente for the kudos!

rlafuente commented 7 years ago

Just went through everything -- this is really awesome work guys, thank you so much for all the improvements. Let me know if there's any place you'd prefer to discuss and sync on next steps.