amaiya / onprem

A tool for running on-premises large language models with non-public data
https://amaiya.github.io/onprem
Apache License 2.0
684 stars 32 forks source link

Add ignore_fn argument to LLM.ingest #58

Closed amaiya closed 3 months ago

amaiya commented 3 months ago

The ignore_fn argument is a Callable that accepts a file path and returns True if it should be ignored. The argument can be used for more fine-grained control of which files to ingest in the vector DB.