Previous logic ensured no overlaps in start and end dates for files to reduce duplication, but this may have been preventing some daily files from being ingested as a large amount of data was missing, so this has been removed. We will instead look to deal with the duplication later.
Previous logic ensured no overlaps in start and end dates for files to reduce duplication, but this may have been preventing some daily files from being ingested as a large amount of data was missing, so this has been removed. We will instead look to deal with the duplication later.