Sometimes if incorrect data was written to the database, (if the calibration coefficient needed to be updated for instance) then it may be necessary to update a large number of datapoints, re-downloading all relevant tdms files.
Currently the preprocessing script overwrites based on the lastModified tag, re-downloading a file if the tag in the db is older than the tag pulled from the google drive on a query. This does not take into account that the configuration values may change.
We should either provide a specific sync() method or add a boolean parameter to preprocessing for check_config or sync to provide this ability. we may even want check_config to be set to true by default.
Sometimes if incorrect data was written to the database, (if the calibration coefficient needed to be updated for instance) then it may be necessary to update a large number of datapoints, re-downloading all relevant tdms files.
Currently the preprocessing script overwrites based on the
lastModifiedtag, re-downloading a file if the tag in the db is older than the tag pulled from the google drive on a query. This does not take into account that the configuration values may change.We should either provide a specific
sync()method or add a boolean parameter to preprocessing forcheck_configorsyncto provide this ability. we may even wantcheck_configto be set to true by default.