istresearch / scrapy-cluster

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
http://scrapy-cluster.readthedocs.io/
MIT License
1.18k stars 323 forks source link

Docker vs Vagrant #192

Closed mshahriarinia closed 6 years ago

mshahriarinia commented 6 years ago

I had a question if you may,

Why is this based on vagrant as opposed to docker? Docker seems to make more sense given that instances are fairly simple and don't need a whole OS.

madisonb commented 6 years ago

Docker is fully supported by this project

Closing.