Closed KianKhadempour closed 1 year ago
Oh yes, thank you for raising this!
I think the problem is that stopwords is being assigned the return value of the .update method, which is None.
This is probably exactly the reason, since update
updates the values in place.
I can add this change to https://github.com/joweich/chat-miner/pull/65 if you want.
I think we should add default stopwords in another PR because this will need some thoughts on how to implement it cleanly as different parsers would require different default stopwords. Also, I would love to introduce an option for automatically pulling standard stopword list (like this) at some point.
This issue is fixed in #65.
I was trying to add default stopwords and I decided to print out the values of the variable before and after. I noticed that before updating it, it would be a completely fine set of strings, but after updating it would be None. Here is the testing code:
The result:
I think the problem is that
stopwords
is being assigned the return value of the .update method, which isNone
. Somehow, though, when I test the code everything works fine. The only problem is adding default stopwords such as in #65. Here is a suggested change:From
To
I can add this change to #65 if you want.