helendallas / FRC_FBIS

Freshwater research Centre FBIS Data Consolidation Management
0 stars 0 forks source link

1. Kruger National Park fish database #123

Closed aneriswanepoel closed 2 years ago

aneriswanepoel commented 3 years ago

3277 fish records extracted from KNP 2009 fish data Ready for ingestion into FBIS

helendallas commented 3 years ago

Duplicates found and removed by @aneriswanepoel

@aneriswanepoel to carefully check all Owners and dates, to make sure these are not included in other datasets, and that the dates are accurate.

All issues need to be captured in a separate spreadsheet and emailed to Robin for clarification

helendallas commented 3 years ago

@aneriswanepoel Please can you update ticket, rather than in an email Thanks

aneriswanepoel commented 3 years ago

@helendallas

Owners checked against other datasets for duplicate data - found duplicates that are in the IA Russell thesis spreadsheet. Duplicates removed from KNP 2009 sheet, amounting to 238 duplicates removed.

Only potential duplicate data is from L Olivier (same as the L Olivier thesis data) with the only difference being the year recorded as 1905 in the KNP 2009 dataset. This is likely wrong - therefore L Olivier could be removed from the KNP 2009 dataset as this data is already recorded in the separate L Olivier thesis dataset.

Waiting to hear back from Robin Petersen regarding the incorrectly recorded dates for the above mention data (L Olivier 1905) as well as data for A Deacon 1905 & 1972.

Referencing - waiting to hear from Robin regarding the correct referencing of "TEAM" as Owner/Collector, as well as how the entire KNP 2009 dataset should be referenced (currently it is Unpublished data)

helendallas commented 3 years ago

Thanks @aneriswanepoel

Please remove L Olivier records from this dataset. Please extract A Deacon 1905 & 1972 records from this dataset and create a separate excel file for checking later. I suspect Robin wont respond timeously.

Revise Team to read : "KNP Fish team"

helendallas commented 3 years ago

@aneriswanepoel

I extracted all U Pienaar data and created a separate file as these data don't belong to Kruger Park. I have made all data = "Database" This is easier to manage in the future

I standardised database names; River Health Programme

I renamed: Kruger National Park fish data and Kruger National Park Fish Data 2009 to Kruger National Park fish database

I replaced: South African National Parks with Kruger National Park Scientific Services as Collector/Owner Institute

helendallas commented 3 years ago

Data from #129 added to Kruger National Park Data and source all made Kruger National Park Fish Database

helendallas commented 3 years ago

@aneriswanepoel Please check if any of these sites already exist on FBIS, for example, Crocodile river @ Crocodile Bridge is X2CROC-CROCB. Then add this code to the FBIS Site Code column. The data will then be added to this site.

aneriswanepoel commented 3 years ago

@helendallas sites checked against those on FBIS - 13 out of 25 already on FBIS with river health codes. FBIS Site Code Column updated accordingly.

aneriswanepoel commented 3 years ago

@helendallas I had a Zoom with Robin to clarify some points:

helendallas commented 3 years ago

Data extracted from Nepid that were labelled as Source = Kruger have been combine with data in this file. See ticket #142

aneriswanepoel commented 3 years ago

@helendallas holding off on FBIS live ingestion until Dimas has sorted out existing codes issue

helendallas commented 2 years ago

@aneriswanepoel Please confirm that these data were added to the image

https://freshwaterbiodiversity.org/map/#search//taxon=&search=&siteId=&collector=&category=&yearFrom=&yearTo=&months=&boundary=&userBoundary=&referenceCategory=&spatialFilter=&reference=["226"]&endemic=&conservationStatus=[]&modules=&validated=&sourceCollection=["fbis","gbif","virtual_museum"]&abioticData=&ecologicalCategory=&rank=&siteIdOpen=&orderBy=name&polygon=&thermalModule=&dst=

aneriswanepoel commented 2 years ago

@helendallas these need to be merged.. but I can't view records for the last two for some reason image

helendallas commented 2 years ago

Done. image