istresearch / scrapy-cluster

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
http://scrapy-cluster.readthedocs.io/
MIT License
1.17k stars 323 forks source link

Is this project no longer supported? #266

Closed flyingdev closed 1 year ago

flyingdev commented 1 year ago

This project looks good and looks some packages are outdated.

Is this project no longer supported?

Thank you

madisonb commented 1 year ago

The original work for this project was created under a contract that required the team to open source it. That contract has since expired, and the team continues to maintain a fork of the open source project internally.

This internal project is still very active but only maintenance or bug fixes are applied to the open source version as the new maintainers see fit. I think PR's and issues are still looked at, but unfortunately given fairly low priority given how the development is currently funded.

Thanks for your interest! If this answers your question please close this issue.

flyingdev commented 1 year ago

That makes sense.