search

AtlasOfLivingAustralia / data-quality-filter-service

0 stars 2 forks source link

Improve the "exclude duplicate records" filter #2

Closed nickdos closed 1 year ago

nickdos commented 2 years ago

As reported by a user, the duplicate filters are removing both representative and associated versions of the records from different datasets. The expected output is to only remove the associated version.

The filter to do this is: &fq=-(duplicate_status%3A"ASSOCIATED"+AND+duplicateType%3A"DIFFERENT_DATASET") however the admin UI cannot generate this style of filter.

Suggested the UI have an option to allow a raw filter to be specified.

peggynewman commented 2 years ago

Alex H worked on this change - I think it might be in the manual feauture branch

The brackets need to be in the query and only a manually input filter can do that. If this can go into databox I can test it.

https://user-images.githubusercontent.com/1271932/176393481-1607f627-b628-4ac3-bbcd-0d92470e19b6.mov

peggynewman commented 2 years ago

I've tested this change successfully and run through the functional testing at https://confluence.csiro.au/display/ALASD/Data+Quality+Filters+Service ... this change is ready for CAB