Closed shatfield4 closed 5 months ago
We should create a data connector that allows scraping websites with a configurable depth
<a>
Is there any documentation on website querying? I have seen anythingllm is compatible with Web site but no way to find the documentation. Thanks for the links/help
What would you like to see?
We should create a data connector that allows scraping websites with a configurable depth
<a>
tags on the site and look for all links that match the original domain name then scrape X levels deep