feat: add chunking by sentences; refactor code; remove semantic chunking for now - Githubissues

jina-ai / late-chunking

Code for explaining and evaluating late chunking (chunked pooling)

Apache License 2.0

244 stars 29 forks source link

feat: add chunking by sentences; refactor code; remove semantic chunking for now #5

Closed guenthermi closed 1 month ago

guenthermi commented 1 month ago

add chunking by sentences
refactor code to move default values out of the chunker class
remove semantic chunking for now