search

TakeLab / spacy-udpipe

spaCy + UDPipe
MIT License
159 stars 11 forks source link

Quick hack for multiword #17

Closed KoichiYasuoka closed 4 years ago

KoichiYasuoka commented 4 years ago

Just hacking for issue #15

asajatovic commented 4 years ago

@KoichiYasuoka thanks for the contribution. Before merging this in master, I would appreciate it if you could add test(s) for this. More specifically, it would be awesome if the new test(s) could include a language with multi-word tokens.

KoichiYasuoka commented 4 years ago

I've just written tests/languages/fr/test_fr_language.py with "Attention aux articles contractés!" and the test suite has passed with the multi-word token "aux" into "à les".

asajatovic commented 4 years ago

I've just written tests/languages/fr/test_fr_language.py with "Attention aux articles contractés!" and the test suite has passed with the multi-word token "aux" into "à les".

Excellent!