Tencent / NeuralNLP-NeuralClassifier

An Open-source Neural Hierarchical Multi-label Text Classification Toolkit
Other
1.83k stars 402 forks source link

how to handle unknow vocabulary on Tencent / NeuralNLP-NeuralClassifier #102

Closed SeekPoint closed 3 years ago

coderbyr commented 3 years ago

vocabulary not in dict map will be mapped to UNK, refer https://github.com/Tencent/NeuralNLP-NeuralClassifier/blob/ecf291812c4235ed6ed01c5343b3b4e629eba2b7/dataset/dataset.py#L52