-
## Problem
The current chunking text-splitting solution is breaking up sentences in the middle of the sentence if that chunk is greater than the max character count. It is nice that it won't break …
jgen1 updated
3 months ago
-
If i try to split text which ends with the split object - index file will not be created.
For example: I have text, and i try to split it with ".", so if text ends with "." last element of the array…
MrRez updated
11 years ago
-
As requested by a member of the community, it would be cool to implement a new feature for splitting documents using an LLM nstead of our current token or delimiter-based methods. This will allow for …
-
Problem with getWordList - doesn't work with splitting by white space and using \W creates some fields in the word list that are not actual words. Need to look into cleaning text.
-
Hi,
It'd be nice to be able to split an entire buffer using text objects as splitting parameter.
Thanks.
-
**Describe the bug**
When using Document Splitter with pdf and `split_type="passage"`, the result is always one document. This is using pypdf.
**Expected behavior**
The understanding I have is …
-
@phraenquex suggests splitting the target table into three modals / panels for:
- Public targets
- Private targets
- Legacy targets (checkbox to show/hide, hidden by default)
There would also …
-
Hello @benbrandt,
First, thank you for your work on the text-splitter library!
I would like to propose a feature enhancement for smarter table splitting that preserves the header in all chunks.
…
-
### Mod loader
Forge
### Minecraft version
1.19.2
### Mod version
1.1.2
### Modloader version
Forge 43.2.21
### Modpack info
_No response_
### If bug:
- [ ] Can you reproduce this issue wit…
-
Hi,
I have worked out using the different data loaders to compare images and video but cannot work out a way to do both simultaneously. It seems using ModalityType.VISION, you can only load and t…