SpaCy tokens can contain universal POS tags and detailed POS tags, both properties in a spacy Token are pos_ and tag_ respectively. Currently, the function pos_ratio is kind of misleading as in the docstring it is describing pos_ tags, but computing ratio using tag_. This ticket is to fix this and implement a similar function using universal POS tags.
SpaCy tokens can contain universal POS tags and detailed POS tags, both properties in a spacy
Token
arepos_
andtag_
respectively. Currently, the functionpos_ratio
is kind of misleading as in the docstring it is describingpos_
tags, but computing ratio usingtag_
. This ticket is to fix this and implement a similar function using universal POS tags.https://github.com/dpalmasan/TRUNAJOD2.0/blob/master/src/TRUNAJOD/surface_proxies.py#L515
Acceptance Criteria
pos_ratio
based on universal POS tag is added.