search

CADWRDeltaModeling / dms_datastore

Data download and management tools for continuous data for Pandas. See documentation https://cadwrdeltamodeling.github.io/dms_datastore/
https://cadwrdeltamodeling.github.io/dms_datastore/
MIT License
1 stars 0 forks source link

Add exceptions to compare directories #41

Closed water-e closed 6 months ago

water-e commented 6 months ago

Main use cases are:

  1. Excluding files such as noaa_.predictions..csv we know will be there. I used regex but if that is overpowered , amenable to dialing back.
  2. Excluding early files present in repo but not in a partial update.
  3. Masking files that are not currently downloaded and that we know will trigger a diff.
water-e commented 6 months ago

Preliminary version is pushed