Monitor Data Loads : Issue with NatureMapr Fetcher - Githubissues

AtlasOfLivingAustralia / data-management

Data management issue tracking

7 stars 0 forks source link

Monitor Data Loads : Issue with NatureMapr Fetcher #1050

Closed cha801p closed 2 weeks ago

cha801p commented 2 months ago

NatureMapr Fetcher is unable to delete the duplicates found in the data frame.
Code fails only when duplicates are found
There is a code to delete duplicates in the fetcher
Needs thorough investigation

cha801p commented 2 months ago

Ticket Update: 17 April 2024 (1 PM)

Issue Identified: Fetcher fails upon identifying duplicates in the data frame

Actions Taken: Fetcher code altered

Function to identify, count and delete duplicates altered
Target variable added to the function call
Return statement added to the function
Hotfix branch created on the master
Code pushed to master
Tested Preingestion locally

Pull request: https://github.com/AtlasOfLivingAustralia/preingestion/pull/240

Status: Waiting for branch to be merged