search

bgabor99 / News_crawler

0 stars 0 forks source link

Crawl all pages in the domain in one spider #11

Closed bgabor99 closed 1 year ago

bgabor99 commented 1 year ago

If possible iterate through all the pages in the domain Check the response codes And other? Think and discuss

bgabor99 commented 1 year ago

PR: #35