-
It is possible to keep unigrams in `tokens_ngrams()` by setting `n = 1` but it is not in `tokens_compound()`. Keeping unigrams makes it easy to apply pattern matching in the downstream. How about add…
-
**Is your feature request related to a problem? Please describe.**
I want to use a multilingual model from Huggingface ( https://huggingface.co/intfloat/multilingual-e5-large ) and the tokenizer is a…
-
Unigram is a FOSS Telegram app for Windows, available in the Microsoft store.
Features:
* Native UWP-based UI
* Ability to choose from different emoji fonts from well-known platforms
* supports …
-
Hello.
Unigram plus addon isn't compatible with newest NVDA version.
Please, could You rewrite It for new NVDA's version to be compatible?
Thank You.
Best regards
Marco Oros
-
import pkuseg
seg = pkuseg.pkuseg(model_name='./pkuseg_postag/') # 开启词性标注功能
text = seg.cut('请帮我打开空调') # 进行分词和词性标注
print(text)
报错如下:
Traceback (most recent call last):
File "C:/Users/Admini…
ghost updated
3 years ago
-
-
I don't know if it is my DNS provider or the site is down, but the url unigram.me is not going to a site that have the link to download and install unigram.
I'm not a user of the unigram software but…
-
Hi! Is it a mistake? There should be 17 instead of 5 in the end.
![Снимок экрана 2022-07-08 в 17 41 45](https://user-images.githubusercontent.com/33065236/178014793-4c788364-c338-43e1-abb7-d33c7c4e5c…
-
The [kenLM](https://github.com/kpu/kenlm) toolkit was able to train a unigram model using the Europarl dataset. However, there are currently two limitations with a unigram model (as oppose to n-gram m…
-
I am using a Kenlm 4gram language model (binary) with Deepspeech2 that works quite well, but I constantly get warnings, that seem unnecessary:
"WARNING:pyctcdecode.decoder:Unigrams not provided and…