Space AI - Smart Embeddings - Githubissues

alkem-io / alkemio

START HERE! Cross project collaboration and shared documentation.

European Union Public License 1.2

23 stars 4 forks source link

Space AI - Smart Embeddings #1337

Open bobbykolev opened 3 weeks ago

bobbykolev commented 3 weeks ago

Description

We need smarter ingestion support for files and callouts to improve the quality of the results.

Must have scope

[ ] Preserve the context when splitting chunks.
[ ] Gather more context when reading chunks.
[ ] Use elastic search ingestion instead of VectorDB?
[ ] Improve Excel ingestion - extract in separate epic
[ ] ... Investigate multiple embeddings. Context increase, tokens limit?