-
I have plain text without any punctuation or sentence stop in German.
How can i make the sentence segments with stop.?
-
Hi,
I take it that on average, the length of sentences is inversely correlated to the quality of their embeddings. For this reason, I want to try breaking down long sentences into simpler clauses t…
-
The sentence counter is not really usable in real-world scenarios and should at least support the inclusion of a common abbreviation list for the current language (or multiple languages?).
See http:/…
-
Sometimes the segmentation of a sentence into words is not optimal.
Allow the user to improve it.
Ideas:
- try another segmentation library: https://chatgpt.com/share/c5d8b072-8531-4395-8566-ae…
-
There is a version conflict between SentenceTransformer and infinity-sdk 0.3.0.dev5, resulting in a Segmentation fault.
-
我在进行使用时,遇到
from FlagEmbedding import FlagModel
zsh: segmentation fault python
zsh: segmentation fault python eval_C-MTEB.py
这两个包均不能使用,sentence_transformers在进行使用时也会报错,但进行修改降低版本为2.2.2后可进行使用,
希望…
-
I think it would be good to have better support for other languages where the concept of sentence and word boundaries vary. Implementing word-based movements equivalent to the current ones would be he…
-
-
I was expecting sentence segmentation to purely break the text into a list of sentences. However the method apparently also inserts some spaces within each sentence. To reproduce consider this example…
-
Read the blog post here: https://dzone.com/articles/using-natural-nlp-module
Wondering if `Punkt sentence segmentation` as been added? I don't seet iin README. If not, I can take a crack at it.
Or …