The new logic will process all of the entries into the data tracker object before processing the spatial files into the output geodatabase. This results in a more consistent workflow and the fallback --resume functionality working better. Geopandas/fiona was also introduced for some of the processing rather than ArcPy for better performance and simplicity.
Changes:
Datatracker entries now created when walking through the ripple unzipple output before any spatial processing
project spatial id is now calculated based on the highest (latest) project spatial id suffix instead of the number of number of entries for the project number fixing an issue when one gets removed
Geopandas/fiona now introduced to some of the spatial and file processing
Output geodatabase bug fixes for transferring and creating
Added the ability to sort or filter the record reviser, in spatial transformer only entries created in the last day should be showed to reduce the vast amount of entries shown
Fixed some locking and deleting errors with the network transfer
This pull request corresponds to the new processor logic in spatial transformer in the issue https://github.com/cat-cfs/twobilliontoolkit/issues/18
The new logic will process all of the entries into the data tracker object before processing the spatial files into the output geodatabase. This results in a more consistent workflow and the fallback --resume functionality working better. Geopandas/fiona was also introduced for some of the processing rather than ArcPy for better performance and simplicity.
Changes: