issues
search
benbrandt
/
text-splitter
Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens, and is callable from Rust and Python.
MIT License
245
stars
15
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
v0.13.3 - Fix tree-sitter-python specification
#208
benbrandt
closed
3 months ago
0
Prep CodeSplitter Python bindings and release
#206
benbrandt
closed
3 months ago
1
Bump electron-to-chromium from 1.4.786 to 1.4.787 in /docs in the minor group
#205
dependabot[bot]
closed
3 months ago
0
Bump tokio from 1.37.0 to 1.38.0 in the minor group
#204
dependabot[bot]
closed
3 months ago
0
Bump the minor group in /docs with 2 updates
#203
dependabot[bot]
closed
3 months ago
0
Use tree-sitter 0.20.2 instead of 0.22.6
#202
boxbeam
closed
3 months ago
7
Bump the minor group with 4 updates
#201
dependabot[bot]
closed
3 months ago
0
Bump the minor group in /docs with 4 updates
#200
dependabot[bot]
closed
3 months ago
0
Bump the minor group in /docs with 2 updates
#199
dependabot[bot]
closed
3 months ago
0
Bump the minor group in /docs with 29 updates
#198
dependabot[bot]
closed
3 months ago
0
Bump the minor group with 5 updates
#197
dependabot[bot]
closed
3 months ago
0
Bump the minor group in /docs with 8 updates
#196
dependabot[bot]
closed
3 months ago
0
Bump syn from 2.0.65 to 2.0.66 in the minor group
#195
dependabot[bot]
closed
3 months ago
0
Bump the minor group in /docs with 3 updates
#194
dependabot[bot]
closed
3 months ago
0
Bump sitemap from 7.1.1 to 7.1.2 in /docs
#193
dependabot[bot]
closed
3 months ago
0
Bump the minor group in /docs with 24 updates
#192
dependabot[bot]
closed
3 months ago
0
Bump the minor group in /docs with 4 updates
#191
dependabot[bot]
closed
3 months ago
0
Bump crc32fast from 1.4.0 to 1.4.2 in the minor group
#190
dependabot[bot]
closed
3 months ago
0
Bump the minor group with 4 updates
#189
dependabot[bot]
closed
3 months ago
0
Bump @emnapi/runtime from 1.1.1 to 1.2.0 in /docs in the minor group
#188
dependabot[bot]
closed
3 months ago
0
Bump sharp from 0.32.6 to 0.33.4 in /docs in the minor group
#187
dependabot[bot]
closed
3 months ago
0
Initial starlight setup
#186
benbrandt
closed
3 months ago
0
Bump the minor group with 4 updates
#185
dependabot[bot]
closed
3 months ago
1
Heuristics for very large documents
#184
do-me
closed
2 months ago
9
Bump the minor group with 6 updates
#183
dependabot[bot]
closed
3 months ago
0
Bump the minor group with 4 updates
#182
dependabot[bot]
closed
4 months ago
0
Bump deunicode from 1.4.4 to 1.6.0 in the minor group
#181
dependabot[bot]
closed
4 months ago
0
Bump syn from 2.0.61 to 2.0.63 in the minor group
#180
dependabot[bot]
closed
4 months ago
0
Make experimental CodeSplitter public
#179
benbrandt
closed
4 months ago
1
Bump errno from 0.3.8 to 0.3.9 in the minor group
#178
dependabot[bot]
closed
4 months ago
0
Bump the minor group with 5 updates
#177
dependabot[bot]
closed
4 months ago
0
Initial CodeSplitter
#176
benbrandt
closed
4 months ago
1
fix: Max encoded offset optimization was potentially using the wrong …
#174
benbrandt
closed
4 months ago
1
Bump the minor group with 15 updates
#173
dependabot[bot]
closed
4 months ago
0
Bump the minor group with 6 updates
#172
dependabot[bot]
closed
4 months ago
0
Semantic level cleanup
#170
benbrandt
closed
4 months ago
1
Bump anstyle from 1.0.6 to 1.0.7 in the minor group
#169
dependabot[bot]
closed
4 months ago
0
Bump the minor group with 2 updates
#168
dependabot[bot]
closed
4 months ago
0
Bump cc from 1.0.95 to 1.0.96 in the minor group
#166
dependabot[bot]
closed
4 months ago
0
Performance: use all available CPU cores
#165
do-me
opened
4 months ago
2
remove dbg
#164
Sagebati
closed
4 months ago
2
Bump the minor group with 2 updates
#163
dependabot[bot]
closed
4 months ago
0
Bump the minor group with 6 updates
#162
dependabot[bot]
closed
4 months ago
0
feat: Add chunk overlap setting
#160
benbrandt
closed
4 months ago
1
Bump the minor group across 1 directory with 8 updates
#158
dependabot[bot]
closed
4 months ago
0
Bump the minor group across 1 directory with 7 updates
#157
dependabot[bot]
closed
4 months ago
1
rust_tokenizers support
#156
benbrandt
closed
4 months ago
1
Bump the minor group with 2 updates
#155
dependabot[bot]
closed
4 months ago
1
feat: Remove SemanticSplit trait and replace it with SemanticLevel
#154
benbrandt
closed
4 months ago
1
Release wasm version
#152
do-me
opened
4 months ago
3
Previous
Next