search

istresearch / scrapy-cluster

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
http://scrapy-cluster.readthedocs.io/
MIT License
1.17k stars 323 forks source link

Crawler image - Python dependency fix #261

Closed igortelheiro closed 2 years ago

igortelheiro commented 2 years ago

I tried to use "docker-compose up" and the crawler image failed to build.

I looked at the dependency that was failing to download and found that the name of the lib was missing a letter.

After the change everything worked well.