sirocco-ventures / raggenie

RAGGENIE: An open-source, low-code platform to build custom Retrieval-Augmented Generation (RAG) Copilets with your own data. Simplify AI development with ease!
https://www.raggenie.com
MIT License
138 stars 52 forks source link

Enhance Website Scraper Plugin to Support Subpage Crawling via Flag #141

Closed sajosam closed 2 weeks ago

sajosam commented 2 weeks ago

This update modifies the website scraper plugin to add flexibility by introducing a flag. The flag determines whether the scraper scans only the homepage or includes subpages. This change allows more control over the scraping process.