search

smoothnlp / SmoothNLP

专注于可解释的NLP技术 An NLP Toolset With A Focus on Explainable Inference
GNU General Public License v3.0
624 stars 112 forks source link

新词发现 #63

Open Nickname1230 opened 3 years ago

Nickname1230 commented 3 years ago

SmoothNLP-master/smoothnlp/algorithm/phrase/ngram_utils.py", line 75, in _process_corpus_chunk ngram_keys[ni] = (ngram_keys[ni] | nigram_freq.keys()) MemoryError 问题是ngram_keys过大？有什么优化方法吗