-
`src/find_SE_words.py` uses log odds ratio to find words that can distinguish a GH comments from other comments. I'm comparing between GH comments and a[nother toxicity dataset](https://www.kaggle.com…
-
In the transition between scikit-learn 0.22.2.post1 and 0.23.0 I noticed that I get different results from CountVectorizer for the same input text when I limit the feature set. I couldn't find a docum…
-
I am using virtualenv python3 in spacemacs.
```
#+BEGIN_SRC python
from sklearn.feature_extraction.text import CountVectorizer
vectorizer = CountVectorizer()
corpus = ["I come…
-
![IMG-20201008-WA0032~2](https://user-images.githubusercontent.com/63952465/95490438-db6cc000-09b5-11eb-9856-091a91475d75.jpg)
![IMG-20201008-WA0031~2](https://user-images.githubusercontent.com/639…
-
#### Describe the bug
Because of the use of Lambda functions in the wrappers around Pipeline.score, it is impossible to test whether the model's score function is itself.
#### Steps/Code to Re…
-
#### Describe the bug
1) A BallTree is created using a set of points that include duplicate values, representing different objects in the same spatial position;
2) The tree is queried using a …
-
I am working on a NLP project...
I wanted to know how much memory does a CountVectorizer object takes. getsizeof() returns 56 where the vocab itself is of 22000 bytes which is much more than thee …
-
For NLP problems, TF-IDF is a common pre-processing approach. SKlearn has a simple interface for this here: https://scikit-learn.org/stable/modules/generated/sklearn.feature_extraction.text.TfidfVecto…
-
#### Describe the bug
Entries in the `transformer_weights` parameter of `FeatureUnion` which do not correspond to a transformer in the union object are silently ignored. I argue that it would b…
-
I'm fine tuning parameters for a linear support vector machine. There are multiple ways to do it, but I wanted to compare LinearSVC and SDGClassifier in terms of time. I expected the accuracy score to…