SpaCy tokens can contain universal POS tags and detailed POS tags, both properties in a spacy Token are pos_ and tag_ respectively. Currently, the function pos_ratio is kind of misleading as in the docstring it is describing pos_ tags, but computing ratio using tag_. This ticket is to fix this and implement a similar function using universal POS tags.
SpaCy tokens can contain universal POS tags and detailed POS tags, both properties in a spacy
Tokenarepos_andtag_respectively. Currently, the functionpos_ratiois kind of misleading as in the docstring it is describingpos_tags, but computing ratio usingtag_. This ticket is to fix this and implement a similar function using universal POS tags.https://github.com/dpalmasan/TRUNAJOD2.0/blob/master/src/TRUNAJOD/surface_proxies.py#L515
Acceptance Criteria
pos_ratiobased on universal POS tag is added.