UTMediaCAT / mediacat-domain-crawler

Internet domain crawler
0 stars 0 forks source link

Batch crawling #32

Closed RaiyanRahman closed 3 years ago

RaiyanRahman commented 3 years ago

Added batch crawling as a separate script and refactored code.