[ ] During processing a dump, if there are only few records in a file (below a certain threshold - like 1000 records for example),
merge as many input files (if there are that many input files for that data type left) to achieve the threshold processing level.
[ ] output S3 file name should include all numbers of input files that were merged
Scope:
[ ] During processing a dump, if there are only few records in a file (below a certain threshold - like 1000 records for example), merge as many input files (if there are that many input files for that data type left) to achieve the threshold processing level.
[ ] output S3 file name should include all numbers of input files that were merged