anonymization.apply_regex_anonymization previously only takes in ID from muliwai.pii_regexes.regex_rulebase, resulting faulty anonymization. With the update, all keys (NER Types, such as NORP, AGE, etc) will be included.
For test cases in test_anonymization.py, fake.address() is changed to fake.street_address, as fake.address() would return full address with \n.
anonymization.apply_regex_anonymizationpreviously only takes inIDfrommuliwai.pii_regexes.regex_rulebase, resulting faulty anonymization. With the update, all keys (NER Types, such asNORP,AGE, etc) will be included.For test cases in
test_anonymization.py,fake.address()is changed tofake.street_address, asfake.address()would return full address with\n.