amaiya / onprem

A tool for running on-premises large language models with non-public data
https://amaiya.github.io/onprem
Apache License 2.0
684 stars 32 forks source link

Add clean function to Extractor.apply #69

Closed amaiya closed 3 months ago

amaiya commented 3 months ago

The clean_fn parameter is a Callable that will clean text prior to be fed to LLM.