Custom Crawler for Summer Design Project 2016

This is the custom crawler for the Lyrics Search Engine project of summer 2016, written in Python3.

Supported sites

• hindilyrics.net
  Usage - python hindilyrics-crawler.py <number of threads>

• smriti.com
  Usage - python smriti-crawler.py <number of threads>

• azlyrics.com
  Usage - python azlyrics-crawler.py <number of threads
  Warning : Put only 1 thread to avoid getting blacklisted

• lyricsmasti.com
  Usage - python lyricsmasti-crawler.py <number of threads>

• metrolyrics.com
  Usage - python metrolyrics-crawler.py <number of threads>