teresaupdyke / qccodar

This Python code applies several quality control (QC) functions based on CODAR SeaSonde (COS) Radial Metric data.
GNU General Public License v2.0
2 stars 2 forks source link

Fix auto() to only reprocess new files #2

Open neaptide opened 2 years ago

neaptide commented 2 years ago

Current function in qccodar.app auto() is not working -- reprocess all the files found in /Codar/Data/RadialMetric/{patternType} regardless of previous run an hour ago

  1. Method should be to check difference in file listing between /Codar/Data/RadialMetric/{patternType} with /Codar/Data/RadialShorts_qcd/{patternType} and see what's new in RadialMetric and process new.
  2. create second function for auto that implements watchdog -- refer to v1.0.dev1 where it was tried before: https://github.com/nccoos/qccodar_py2.7/releases/tag/1.0.dev1
teresaupdyke commented 2 years ago

The first step in the task has been completed.