There're some situations that I want to scrape multiple organized pages to one directory, but it will throw an error.
So, is possible to add an option to suppress the error when directory exists(though I can delete the code of throwing error)?
PS:
The reason why I don't use [url1, url2, ...] in urls option is that I want fully control of the scrapping process, like use 'promise-limit' to limit the concurrency and resume scraping after break.
Description
There're some situations that I want to scrape multiple organized pages to one directory, but it will throw an error. So, is possible to add an option to suppress the error when directory exists(though I can delete the code of throwing error)? PS: The reason why I don't use
[url1, url2, ...]
inurls
option is that I want fully control of the scrapping process, like use 'promise-limit' to limit the concurrency and resume scraping after break.