search

buckyroberts / Spider

Python website crawler.
https://thenewboston.com/
969 stars 666 forks source link

replaced urlopen and urllib.request with requests BeautifulSoup and #146

Closed Moishale closed 2 years ago

Moishale commented 2 years ago

replaced urlopen and urllib.request with requests BeautifulSoup cause its faster and added an execution timer decorator to general

Moishale commented 2 years ago

replaced urlopen and urllib.request with requests BeautifulSoup cause its way faster than before and added an execution timer decorator