search

mishushakov / llm-scraper

Turn any webpage into structured data using LLMs
MIT License
2.42k stars 147 forks source link

Custom mode #28

Closed lamoglia closed 4 months ago

lamoglia commented 4 months ago

Implements a custom mode in which the user is allowed to provide its own prerprocessing fuction allowing operation such as discading unwanted data, sanitization, enrichment and any type of transformation before building the prompt for the llm

mishushakov commented 4 months ago

Good change, I like it. Thank you so much 🙏