Open PhyllisJi opened 2 years ago
This error indicates that the number of tokens in a sentence is not the same between the feature vectors (from BERT or ELMO) and the received text. Thus, checking the number of spaces or control codes in the text may solve the problem. Note that you can see the number of tokens in the issued sentence at the line before the assertion error like the format NUM_OF_TOKENS_IN_FEATURE, NUM_OF_TOKENS_IN_TEXT
.
How can I fix it?