Spider from List URLS - Githubissues

workeffortwaste / horseman

The detailed update and issue repository for the Horseman crawler.

https://gethorseman.app/

16 stars 0 forks source link

Spider from List URLS #50

Closed jessthebp closed 2 years ago

jessthebp commented 2 years ago

"Crawl from list" currently does not support additional spidering. This feature would allow the user to choose whether to just crawl a list or spider out from a list with multiple starting URLs.

workeffortwaste commented 2 years ago

Feature added in 0.2.0 via a toggle on the List Crawl page.