search

crwlrsoft / crawler

Library for Rapid (Web) Crawler and Scraper Development
https://www.crwlr.software/packages/crawler
MIT License
325 stars 11 forks source link

Base Http step also works with array of URLs #72

Closed otsch closed 1 year ago

otsch commented 1 year ago

The base Http step can now also be called with an array of URLs as a single input. Crawl and Paginate steps still require a single URL input.