Open marioliu opened 4 years ago
Sometimes crawling takes too long because the content doesn't load. Is there a way to specify a retry option that retries crawling a URL if it exceeds timeout?
retry
timeout
Sometimes crawling takes too long because the content doesn't load. Is there a way to specify a
retry
option that retries crawling a URL if it exceedstimeout
?