[AUTO] Update data - Githubissues

damianooldoni-bot commented 8 months ago

Brief description

This is an automatically generated PR. The following steps are all automatically performed:

Fetch raw data
Map raw data to DwC standard and save the output in ./data/processed
Get an overview of the changes
Run some tests, e.g. check the uniqueness of occurrenceID, check that all occurrences have a eventID and scientificName, ...

Note to the reviewer: the workflow automation is still in a development phase. Please, check the output thoroughly before merging to main. In case, improve the data fecthing fetch_data.Rmd, the mapping dwc_mapping.Rmd, both in ./src or the GitHub workflows fetch-data.yaml and mapping_and_testing.yaml in ./.github/workflows.

PietrH commented 8 months ago

This PR only has 2000 lines in it's occurrence.csv, something clearly has gone wrong

PietrH commented 8 months ago

Records with multiple values for Waarneming are currently removed until #23 is fixed, however, this is detected on a separator including a space. This separator seems to be present in a lot of records even if there aren't multiple values.

Remove occurrences containing multiple type - value pairs information in column waarneming (patch until #23 is solved):

#remove records with multiple values for waarneming
input_data %<>%
  filter(is.na(.data$waarneming) | 
           !str_detect(.data$waarneming, pattern = "; "))

riparias / rato-occurrences

[AUTO] Update data #151

Brief description