search

inbo / data-publication

🔓 Open biodiversity data publication by the INBO
https://ipt.inbo.be
Creative Commons Attribution 4.0 International
15 stars 7 forks source link

Republish gull tracking data (without CartoDB) #138

Closed peterdesmet closed 7 years ago

peterdesmet commented 7 years ago

Instead from CartoDB (which we no longer want as a chain in the publication process), the gull tracking data should be published from closer to the source i.e. the SQL lite database generated from UvA-BiTS. We'll have to see if the information currently available in the published data (http://data.inbo.be/ipt/resource.do?r=bird-tracking-gull-occurrences) can be retrieved or calculated from that DB.

The data in the currently published dataset goes through 2 steps:

  1. Import from UvA-BiTS export into CartoDB + do some transformations: https://github.com/inbo/bird-tracking/blob/master/cartodb/import-procedure.md
  2. Create a Darwin Core view: https://github.com/inbo/data-publication/blob/master/datasets/bird-tracking-gull-occurrences/mapping/dwc-occurrence.sql

A sample of the result can be found at https://github.com/inbo/data-publication/blob/master/datasets/bird-tracking-gull-occurrences/mapping/dwc-occurrence-100.csv

Note that in the WHERE clause only HG and LBG data should be present and occurrences until 6 months ago (30 September 2016)

peterdesmet commented 7 years ago

This is now implemented and documented here. The whole change was this pull request: https://github.com/inbo/data-publication/pull/142

The data is now ready to be uploaded to IPT, but the disk space needs to be increased first.

peterdesmet commented 7 years ago

Dataset has been republished on April 26th.