Butterflies Fetcher Fix

Ticket Update: January 25, 2024 (4 PM)

Issue: Butterflies Fetcher Fixes

Actions Taken:

[x] The following changes were made to the code:
1. def get_date_from(self) - function added to the code This function will fetch lastLoadDate from solr. This date would then be passed to the API URL which uses this date as a parameter to fetch the records after this date. (incremetal_load: true in collectory)
2. last_date_url - URL added to baseconfig Added URL to the baseconfig to retrieve data from solr
[x] The code has been tested locally
[x] Code pushed and pull request created

Pull request: https://github.com/AtlasOfLivingAustralia/preingestion/pull/234 Status: Waiting for the branch to be merged

Next step: Test on databox/prod

AtlasOfLivingAustralia / data-management