Implement dynamic batch parameters in polygon_processor.py
A function, calculate_batch_params, has been added to dynamically calculate BATCH_PERCENTAGE and NUMBER_OF_SUBSETS based on the number of total data points. This improves the scaling and performance of the polygon processing operation. The other changes involve restructuring the code for better organization.
Implement dynamic batch parameters in polygon_processor.py A function, calculate_batch_params, has been added to dynamically calculate BATCH_PERCENTAGE and NUMBER_OF_SUBSETS based on the number of total data points. This improves the scaling and performance of the polygon processing operation. The other changes involve restructuring the code for better organization.