gbif / ipt

GBIF Integrated Publishing Toolkit (IPT)
https://www.gbif.org/ipt
Apache License 2.0
124 stars 58 forks source link

OBIS qc checks with IPT? #1670

Open ymgan opened 2 years ago

ymgan commented 2 years ago

Hey,

I remember it was mentioned in the TDWG2021 conference that the new dwca validator will includes feature like bookmarkable QC report page and synced GBIF QC flags and it will be integrated into IPT. It was also mentioned in the global node meetings to foster stronger collaboration with OBIS.

I am wondering if it is possible to envision a collaboration with OBIS such as integrating some OBIS specific QC checks (e.g. a record is_marine or not etc) to the validator (and hence the IPT)? What do you think?

Thank you so much!!

Cheers On behalf of OBIS data quality task team

timrobertson100 commented 2 years ago

Thanks @ymgan Yes, we would very much like to explore what can be done.

The IPT will call the GBIF validator service. We're just finishing up some cleanup of that, which will mean that it effectively runs a "dry run" of the GBIF data ingestion and provides a summary report. This means to accommodate checks, we need to get them into the GBIF pipeline project itself.

I've opened an issue to capture that. Can you please summarise or link to a doc covering the checks you're keen to include on that issue in the pipelines project, please?

We'll leave this issue open so that we verify it works in the IPT when the IPT/Validator integration is working.