APII Fetcher Failure

[cha801p]

Ticket Update: July 17, 2024 (1:30 PM)

Issue: APII Fetcher failed

Solution: Fix APII fetcher code

Actions Taken: Set up containers to execute the code locally The code was tested locally and found the same issue as EMR _File "/home/hadoop/.local/lib/python3.9/site-packages/pandas/core/indexes/base.py", line 6252, in _raise_if_missing raise KeyError(f"{notfound} not in index") KeyError: "['Occurrence Remarks'] not in index" Command exiting with ret '1' Occurrence Remarks column is missing from the data provided by the data provider Tested code by removing Occurrence Remarks column - Code works perfectly

Possible solutions: Push changed code as hotfix / ask the data provider about the change / create a new branch to push the changes

[cha801p]

https://github.com/AtlasOfLivingAustralia/preingestion/pull/254

[cha801p]

Ticket Update: August 1, 2024 (11:30 PM)

• [x] Code altered
• [x] Data tested on databox
• [x] Code tested on databox
• [x] Code pushed
• [x] Pull request created
• [x] Pull request approved

[cha801p]

• [x] Fixed code deployed on prod
• [x] Fetcher is working again

[cha801p]

Ticket Update: August 19, 2024 (9:30 AM) The fetcher is working as expected