-
- [ ] 2>ngrams >ngrams alternative
- [ ] apertium stream parser
- [ ] collapsing rules
- [ ] cite corpora
- [ ] better installation steps when config is errored
- [ ] check if tools are working, …
-
Hi, very impressive work on data clean and deduplication pipeline!
I got a question on the to_hash step. Would this 'get_feature' function return Ngrams with alphabet format instead of word format?…
-
## 🚀 Feature
I'm seeing the following error in torch script when scripting an nn.Module that contains a dictionary of tuple (or list) data type as keys.
RuntimeError: Cannot create dict for key ty…
-
- We lost 3% precision on classifier due to N-grams (from 2 Ngrams to 1)
-
### Discussed in https://github.com/scikit-learn/scikit-learn/discussions/22195
Originally posted by **Pruthwik** January 12, 2022
For Whitespace sensitive char-n-gram tokenization, TFIDF vect…
-
```
I was looking at the DKPro functionality, and I saw this page about how to work
with NGrams in DKPro
http://code.google.com/p/dkpro-core-asl/wiki/WorkingWithNGrams
While we have all of this func…
-
Worth considering?
https://www.tidytextmining.com/ngrams.html#using-bigrams-to-provide-context-in-sentiment-analysis
-
I would like to dynamically add OOV words into pretrained KenLM model without retraining the model? Is it possible?
-
We never checked that ngrams works correctly with transforms. Need to check that they do and add a test to cover this combination.
-
I'm getting a crash running latest structureshrink in --principal mode, does this ring any bells? I can teach you to reproduce this but it's going to be a pain since you need to build a pretty old ver…