Prepare a stack with Python 3.9 + Scrapy 2.5

scrapinghub / scrapinghub-stack-scrapy

Software stack with latest Scrapy and updated deps

BSD 3-Clause "New" or "Revised" License

62 stars 20 forks source link

Closed vshlapakov closed 3 years ago

vshlapakov commented 3 years ago

taking https://github.com/scrapinghub/scrapinghub-stack-scrapy/pull/157 as a base (thanks @DharmeshPandav!)
rebasing it against updated branch-2.4 with fixed CVEs
upgrading all other dependencies where appropriate

DharmeshPandav commented 3 years ago

Thanks @vshlapakov Unrelated but I am adding this comment here as they are co-related and part of the same workflow https://github.com/scrapinghub/shub/pull/382/files

Shub: add sources index to requirements.txt file before deploy during Autodeploy on scrapy cloud