[add] integrate Semantic text splitter for better performance

langchain-ai / langchain

🦜🔗 Build context-aware reasoning applications

https://python.langchain.com

MIT License

84.79k stars 13.1k forks source link

[add] integrate Semantic text splitter for better performance #20987

Closed rgupta2508 closed 5 days ago

rgupta2508 commented 2 weeks ago

text_splitter: Added Semantic text splitter (https://docs.rs/text-splitter/0.12.1/text_splitter/) for better performance and more option of splitter to user Adding SemanticCharacterTextSplitter, SemanticTiktokenTextSplitter

vercel[bot] commented 2 weeks ago

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
langchain	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	May 8, 2024 8:38am

hwchase17 commented 5 days ago

imo this is too overlapping with existing langchain functionality where i dont think there is a ton of benefit in including a wrapper integration