BIDS-projects / scraper

Collects data from websites of data science institutions
2 stars 0 forks source link

Optimize scraper for broad crawling #30

Open don-han opened 8 years ago

don-han commented 8 years ago

Relevant url: http://doc.scrapy.org/en/latest/topics/broad-crawls.html