search

UMNLibraries / experts_etl

Moves data from UMN to Pure (Experts@Minnesota), and vice versa.
3 stars 0 forks source link

Automatically remove UMN data errors whenever possible. #12

Open nihiliad opened 4 years ago

nihiliad commented 4 years ago

For example, when we are unable to generate any data for a person because all jobs have status_flg F (future), the ETL system could automatically delete the row from umn_data_error once we are able to generate data.

nihiliad commented 2 years ago

There are other common cases of ineligibility we could check for, too, like paygroup PLH, excluded colleges, etc. However, persons with these sorts of ineligibility were probably added mistakenly in the first place, and will need to be removed from Experts DW. See: https://github.com/UMNLibraries/experts_etl/issues/30