Currently, the tagger works but can be a bit flaky, and might fail for weird edge cases.
One way to ensure that both the code isn't broken and also produces expected tags, we could have some unit tests to assert the output of tagger for specific input sentences we design.
These tests would have to be language specific almost certainly, which could be a pain in the ass, so I think this is only mid-priority
Currently, the tagger works but can be a bit flaky, and might fail for weird edge cases.
One way to ensure that both the code isn't broken and also produces expected tags, we could have some unit tests to assert the output of tagger for specific input sentences we design.
These tests would have to be language specific almost certainly, which could be a pain in the ass, so I think this is only mid-priority