added late chunking recipe

weaviate / recipes

This repository shares end-to-end notebooks on how to use various Weaviate features and integrations!

478 stars 100 forks source link

added late chunking recipe #141

Closed dannyjameswilliams closed 2 weeks ago

dannyjameswilliams commented 2 weeks ago

Description

An implementation of late chunking within Weaviate, showing that a weaviate search gets the same results as a standard late chunking search with cosine similarity, and a comparison to naive chunking

Contribution Type

[ ] Integration
[x] Weaviate feature

erika-cardenas commented 2 weeks ago

Awesome, thanks @dannyjameswilliams!