Fixed missing diac error.

CAMeL-Lab / camel_tools

A suite of Arabic natural language processing tools developed by the CAMeL Lab at New York University Abu Dhabi.

MIT License

413 stars 73 forks source link

Closed go-inoue closed 1 year ago

go-inoue commented 1 year ago

Fixed the error that occurs when the word is not found in the analyzer where it tries to find its diac feature from the BERT predictions, which does not exist.
We use dediacritized words for those unknown words.