Open IlnarSelimcan opened 4 years ago
https://github.com/taruen/ud-tools/commit/d0819a0295304bb1d7e69c2489e5e37c1fe2f206 solves most of the validation issues related to auxiliaries except for the following:
[Line 7883 Sent udhr.tagged.txt:7:305 Node 8]: [L3 Syntax leaf-aux-cop] 'cop' not expected to have children (8:болса:cop --> 9:да:advmod)
[Line 10375 Sent Иран.tagged.txt:52:1481 Node 12]: [L3 Syntax rel-upos-aux] 'aux' should be 'AUX' but it is 'VERB'
[Line 12859 Sent wikipedia.tagged.txt:71:1163 Node 5]: [L5 Morpho aux-lemma] 'атан' is not an auxiliary verb in language [kk]
[Line 13815 Sent Шымкент.tagged.txt:6:156 Node 2]: [L3 Syntax leaf-aux-cop] 'cop' not expected to have children (2:болғанда:cop --> 3:да:advmod)
атан
in 12859 looks like a main verb.
https://github.com/apertium/apertium-kaz/pull/16 convolutes changes to the Constraint Grammar with the corrections in the UD treebank. To make merging easier/faster, I decided to make a separate PR out of the latter.
I worked on the conllu file directly. The changes to it will have to be "backpropagated" into
tagged.txt
files.A brief description of the changes.
nmod
were changed toobl
, as they should be according to version 2 of the annotation guidelines:The majority of the validation errors were like the following:
which was due the incompleteness / out-of-datedness of the language-specific
documentationrather than the issues with the treebank itself (turns out that these language-specific lists of auxiliaries & copulas are kept in the validation script itself. A pull-request has been made to it, see below).Note that as of yet the treebank does not fully validate, about 20 issues remain.
I've double checked my own changes by going over https://github.com/apertium/apertium-kaz/pull/17/files having opened up the treebank before and after in UD-Annotatrix. Please let me know if you think that I've made things worse, especially if you notice that I made an error consistently.
Reviewing this PR carefully is likely to take three-four full working days. That's what double checking my own changes seemed to take me.
I really hope that the next release of UD (scheduled for November 15, data freeze is on November 1) will include this new version. What remains to be done:
Auxiliaries need to be added to validate.py.digging
in the sentenceThe boss said to start digging
in the guidelines is labeled asxcomp
ofstart
, whereas in Kazakh we treatбаста
in-A.<gna_impf> баста-
as anaux
. Also, unlike all other verbs in the above pull request,баста
is not listed among the auxiliary verbs inKazakh: A Comprehensive Grammar
, although it probably should be handled as such as we do currently.