scrapy / scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.
https://scrapy.org
BSD 3-Clause "New" or "Revised" License
50.99k stars 10.34k forks source link

Remove tests/requirements.txt #6270

Closed Gallaecio closed 1 month ago

Gallaecio commented 2 months ago

I think we should remove https://github.com/scrapy/scrapy/blob/master/tests/requirements.txt and move its packages to tox.ini. This will improve the experience when changing packages or package versions there (tox only detects changes in tox.ini, not in referenced files). It will also make it so that we have all test deps defined in a single place.

It would also be a good moment to try and move some of the dependencies there to the “extra” tox environments, instead of installing them in all environments, so that we can be sure that tests pass without extra dependencies.