Single Crawl Queue separate from master implementation - Githubissues

gauthamsunjay / ariados

A scalable web crawling framework using lambdas

0 stars 0 forks source link

Single Crawl Queue separate from master implementation #3

Open gauthamsunjay opened 5 years ago

gauthamsunjay commented 5 years ago

Rocksdb crawlqueue
Can we use amazon services for the crawlqueue