Wrong tokenizer in ner.py

proycon / deepfrog

An NLP-suite powered by deep learning

GNU General Public License v3.0

19 stars 1 forks source link

Closed KenSentMe closed 4 years ago

KenSentMe commented 4 years ago

Thanks for sharing some examples for implementing Deepfrog. I noticed that in the ner.py, line 21 you state

tokenizer=modelname

Shouldn't that be

tokenizer=tokenizer

proycon commented 4 years ago

Right, it should! It shouldn't have an impact in the example though since those tokenizer models are identical.