Budget not respected - Githubissues

spider-rs / spider

A web crawler and scraper for Rust

https://spider.cloud

MIT License

1.11k stars 96 forks source link

Closed CrazyDubya closed 5 months ago

CrazyDubya commented 5 months ago

spider -v --budget "*,1" --url www.nypost.com/ crawl leads to full listing of links

j-mendez commented 5 months ago

fixed v1.97.9 ty