Open tijmengit opened 3 years ago
Cleaning up browser.py
in get_sitemap of browser, url will be only added to queue for 2-depth if it appears in self.synonyms['login']
Cleaning up browser.py