search

LiyuanLucasLiu / ArabicNER

Arabic NER system with a strong performance
https://www.aclweb.org/anthology/W19-4607.pdf
Apache License 2.0
34 stars 10 forks source link

Excessive memory use when loading embeddings #7

Closed chris-jenkins-isi closed 4 years ago

chris-jenkins-isi commented 4 years ago

Changing this line to simply for line in f helped me to avoid having my Docker environment kill pre_process_test.py

https://github.com/LiyuanLucasLiu/ArabicNER/blob/f455165f51390d70e8b685dea3960560f24d7e9d/abnlp/encoder/str_encoder.py#L159

LiyuanLucasLiu commented 4 years ago

Nice catch! Thanks for bringing this up! Fixed at #779850f