CADWRDeltaModeling / dms_datastore

Data download and management tools for continuous data for Pandas. See documentation https://cadwrdeltamodeling.github.io/dms_datastore/
https://cadwrdeltamodeling.github.io/dms_datastore/
MIT License
1 stars 0 forks source link

autoscreen needs a merge with hand-screening #27

Open dwr-psandhu opened 6 months ago

dwr-psandhu commented 6 months ago

@water-e mused

autoscreen works on data from the repo and puts it in the staging/screened directory (e.g. refactor_test).

  • Currently it is dumb to any previous work, so acceptance isn't based on tests or criteria.
  • This may be an OK design. The question is "at what point do we merge in the previous hand-screening?" Do we want to do this inside the staging/formatted? And persist it before hand-screening? The problem is that it is a bit hard to describe that state.
  • Alternatively, we could apply auto-vs-hand merging at the point of hand screening.

This is needed once we have hand-screening work which is being worked on here https://github.com/dwr-psandhu/dms_datastore_ui/issues/19