[BEA @ ACL 2023] General-purpose tool for linguistic features extraction; Tested on readability assessment, essay scoring, fake news detection, hate speech detection, etc.
Hi, dear author, thank you for your awesome work! I want to bring your attention to a possible bug in the implementation of total_number_of_unique_words_no_lemma function
In lines 194-195 of file lftk/foundation/wordsent.py, the total_number_of_unique_words_no_lemma function still does the lemma operation, even though no lemma is specified. This makes the "total_number_of_unique_words_no_lemma" function almost identical to total_number_of_unique_words.
This will lead to an error that corr_ttr is same as corr_ttr_no_lem
brucewlee
commented
6 months ago
Hi, dear author, thank you for your awesome work! I want to bring your attention to a possible bug in the implementation of
total_number_of_unique_words_no_lemmafunctionIn lines 194-195 of file
lftk/foundation/wordsent.py, thetotal_number_of_unique_words_no_lemmafunction still does the lemma operation, even though no lemma is specified. This makes the "total_number_of_unique_words_no_lemma" function almost identical tototal_number_of_unique_words.This will lead to an error that
corr_ttris same ascorr_ttr_no_lem