Each section is now cleaned before being chunked

danswer-ai / danswer

Gen-AI Chat for Teams - Think ChatGPT if it had access to your team's unique knowledge.

https://danswer.ai

Other

10.76k stars 1.35k forks source link

Closed hagen-danswer closed 1 day ago

hagen-danswer commented 1 day ago

section texts are now scrubbed for all llm providers during indexing.

Note: You have to check that the action passes, otherwise resolve the conflicts manually and tag the patches.

[ ] This PR should be backported (make sure to check that the backport attempt succeeds)

vercel[bot] commented 1 day ago

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
internal-search	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Nov 22, 2024 6:07pm