Closed sbuchbinder closed 4 years ago
I wasnt sure if this was the best way to do it...
Wanted it to be project / install configurable.
Feel free to rename the variable I chose
Hmm I'm a little confused about the intent here. Do you want to add a filter to prevent all records from being repeated, and then have a list of things that should be excluded from the filter? Or do you want to only filter out repeated records provided in the list? Just from looking at the code it seems like the filter passes all records unless it matches a regex in the list.
In the future, I think we should create error/warning codes so that things are slightly easier to reference, but for now this is fine.
Add a key to bpg_config inside of bag_config.yaml called 'duplicate_filter_exclude'. The value of this key is a list of regex-ed strings (so .* is allowed, etc)
ie: