Consider adding a check of consistent 30-minute or 60-minute measurement within the hour across the record in the join_site_data.py module. The measurement window should be consistent with respect to the minute throughout the data record.
Case: A site submitted some files with 30-minute resolution on the 00 and 30 minute of each hour. Another file was submitted with the 30 minutes on the 24 and 54 minute of each hour. And there was overlapping time periods. The combiner selected both sets of timestamps within the overlapping period b/c there was no collision.
This ultimately caused the Data QA/QC run to throw an exception when the code tried to merge the SW_IN_POT data. (due to both the duplicate records within the same time period and the inconsistent 30-minute frequency within the hour.
Consider adding a check of consistent 30-minute or 60-minute measurement within the hour across the record in the join_site_data.py module. The measurement window should be consistent with respect to the minute throughout the data record.
Case: A site submitted some files with 30-minute resolution on the 00 and 30 minute of each hour. Another file was submitted with the 30 minutes on the 24 and 54 minute of each hour. And there was overlapping time periods. The combiner selected both sets of timestamps within the overlapping period b/c there was no collision.
This ultimately caused the Data QA/QC run to throw an exception when the code tried to merge the SW_IN_POT data. (due to both the duplicate records within the same time period and the inconsistent 30-minute frequency within the hour.