Updating GBIF with changes to support invasive species research and monitoring

[qgroom]

Since 2020 Darwin Core has been changed to support the term degreeOfEstablishment; dwc:pathway has been move to core terms and given a controlled vocabulary and the controlled vocabulary for dwc:establishmentMeans has been updated.

These changes should be implemented in GBIF to support research and monitoring of invasive species, and to better indicate data on cultivated, domesticated and captive species.

Further rational for these changes is laid out in this paper...

Groom Q, Desmet P, Reyserhove L, Adriaens T, Oldoni D, Vanderhoeven S, Baskauf SJ, Chapman A, McGeoch M, Walls R, Wieczorek J, Wilson JR.U, Zermoglio PFF, Simpson A (2019) Improving Darwin Core for research and management of alien species. Biodiversity Information Science and Standards 3: e38084. https://doi.org/10.3897/biss.3.38084

Implementing these changes would also resolve issue #1627

Also relevant is https://github.com/tdwg/dwc/issues/235

[timrobertson100]

I understand that @tucotuco will provide us with new editions of the occurrence core for rs.gbif.org which include the fields necessary for this in the DwC-A along with other changes that will bring it up to date.

I propose we start with that for the IPT community and then work up the stack to bring GBIF.org all up to date in one release.

[tucotuco]

Updates to Core and some extension XML files provided in https://github.com/gbif/rs.gbif.org/pull/62.

[timrobertson100]

Thanks a million @tucotuco

That PR brings in changes that @MattBlissett and I will test using the ipt.gbif.org and on www.gbif-uat.org. Once we are sure that is won't break things, we'll merge that.

Following that we'll track the work to implement this request in gbif/pipelines project - this issue will probably move to that repository but I'll leave it here for now so people see this.

[qgroom]

That's great! I appreciate these changes have knock-ons to many parts of the infrastructure! The reason I raised the issue is that I'm writing a paper to encourage more use of these terms and needed some clarity if and when users might be able to make use of these data in the future.

[timrobertson100]

if and when users might be able to make use of these data in the future.

I'd anticipate 1-3 months to complete this (fully operational in GBIF with IPT support and search and download on GBIF.org) depending on how invasive other changes are. If problems arise, we could do the terms of interest to this thread quicker. Let's aim to have this complete before you publish and you can document it as such.

[qgroom]

OK, I'll keep in touch. It would be great to add something to the paper about implementation, even if it wasn't completely finished.

[timrobertson100]

We'll be happy to contribute a short paragraph detailing the schema repository change, the vocabulary server, and the impact on GBIF processing and downloads if you like.