Closed kowaalczyk closed 5 years ago
@Gizzio I have fixed everything you wanted and rebased this against latest spacy and utils master branches. The POS Tagger and Parser treining were left untouched since review, as for the NER I have checked that the training completes successfully after these changes.
I am merging this branch now.
Summary of changes:
EDIT: Now that improved train is merged, we only need to disable lemmatization To reproduce everything, you need the spacy version created by:
followed by a patch to the lemmatizer that effectively disables it:
I'm not pushing this junk to our spacy fork on purpose.
@Gizzio I need your review on this since you need it for the demo backend asap, it shouldn't take long. Also, make sure to check whether it closes #48 or not, I am marking it so that it does but we will need to do this once again after the new lemmatizer is complete.