gbif / ipt

GBIF Integrated Publishing Toolkit (IPT)
https://www.gbif.org/ipt
Apache License 2.0
127 stars 57 forks source link

add newly adopted DwC terms to GBIF's IPT as core terms of Occurrences #1532

Closed asimpson-usgs closed 2 years ago

asimpson-usgs commented 3 years ago

Last year TDWG accepted additional terms and new definitions for old terms to DwC's Occurrence group of terms. They now appear on the quick reference guide. Specifically, establishmentMeans, degreeOfEstablishment, pathway, and occurrenceStatus.

I request these four terms be added to the GBIF IPT's Occurrence group of terms as soon as possible. Their quick reference guide urls: https://dwc.tdwg.org/terms/#dwc:establishmentMeans https://dwc.tdwg.org/terms/#dwc:degreeOfestablishment https://dwc.tdwg.org/terms/#dwc:pathway https://dwc.tdwg.org/terms/#dwc:occurrenceStatus

NOTE: none of the following URL anchor tags are currently resolving properly: https://dwc.tdwg.org/list/#dwc_establishmentMeans https://dwc.tdwg.org/list/#dwc_degreeOfEstablishment https://dwc.tdwg.org/list/#dwc_pathway https://dwc.tdwg.org/list/#dwc_occurrenceStatus

peterdesmet commented 3 years ago

@asimpson-usgs

  1. I have made a pull request to add/update these terms in the Distribution extension (used for checklists): https://github.com/gbif/rs.gbif.org/pull/66
  2. Introducing these terms in the Occurrence core will likely take longer, as we want to combine the introduction of these terms with the upcoming Darwin Core changes that are currently under review.
  3. The anchors now resolve
MattBlissett commented 3 years ago

The new terms and associated vocabularies are now in the "sandbox", and can be used by IPTs in test mode. If you would assist by upgrading any test IPTs you use, and checking the mappings are fine, we'll be able to move them to production fairly quickly.

We do need to check the recordedByID/identifiedByID terms work properly with our system. These were created as GBIF terms, but have now been adopted by DWC, which I think is a new situation.

The schemas are managed outside the IPT, so the issue is/was https://github.com/gbif/rs.gbif.org/issues/21

rukayaj commented 3 years ago

@MattBlissett I've checked these on the GBIF Norway test IPT and the mapping is working fine (occurrence core) when I download the dwca directly from the test IPT, but the terms are not appearing on the GBIF UAT portal (e.g. this record https://www.gbif-uat.org/occurrence/3004256689 should have pathway and degreeOfEstablishment). Should they be? It would be super if we could publish our data with these terms soon.

qgroom commented 2 years ago

Yes, just as encouragement we also have a bunch of datasets and initiatives pending on these terms.

MattBlissett commented 2 years ago

Thanks Quentin, could you link a couple here? We can test them as we implement interpretation on gbif-uat.org.

qgroom commented 2 years ago

These are a couple of datasets that could be updated quickly

Verloove F, Groom Q, Brosens D, Desmet P, Reyserhove L (2020). Manual of the Alien Plants of Belgium. Version 1.10. Meise Botanic Garden. Checklist dataset https://doi.org/10.15468/wtda1m accessed via GBIF.org on 2021-12-11.

Reyserhove L, Groom Q, Adriaens T, Desmet P, Dekoninck W, Van Keer K, Lock K (2020). Ad hoc checklist of alien species in Belgium. Version 1.7. Research Institute for Nature and Forest (INBO). Checklist dataset https://doi.org/10.15468/3pmlxs accessed via GBIF.org on 2021-12-11.

MattBlissett commented 2 years ago

this record https://www.gbif-uat.org/occurrence/3004256689 should have pathway and degreeOfEstablishment

Hi @rukayaj,

Most of the API work to support the updated EstablishmentMeans, DegreeOfEstablishment and Pathway is complete and showing on UAT. The website/portal itself isn't yet updated, so there are some missing English translations and the searching isn't yet working.

albenson-usgs commented 2 years ago

I see this has been closed. Does that mean the terms will be available in the next update of the IPT?

mike-podolskiy90 commented 2 years ago

Yes, they will. The 2.5.6 Release will be available very soon

rukayaj commented 2 years ago

Thanks for your work on this, guys!

qgroom commented 2 years ago

Thanks for your work on this, guys!

Seconded!