D-Star-AI / dsRAG

High-performance retrieval engine for unstructured data
MIT License
852 stars 61 forks source link

bound chunk_length in adjustment function #54

Closed zmccormick7 closed 1 month ago

zmccormick7 commented 1 month ago

Added a lower bound to the chunk_length used for the chunk length relevance value adjustment in RSE. This will keep very short chunks from being effectively ignored.