scrapinghub / spidermon

Scrapy Extension for monitoring spiders execution.
https://spidermon.readthedocs.io
BSD 3-Clause "New" or "Revised" License
526 stars 94 forks source link

Dependencies needs some refactoring #393

Closed VMRuiz closed 11 months ago

VMRuiz commented 1 year ago

There is some confusion on where each dependency should go. For example, requirements.txt contains dependencies both for Spidermon and auxilar development tools like black and pre-commit.

There is a requirements-docs.txt but not a requirements-dev.txt

Then, setup.py contains extra_require both for Spidermon features - monitoring, validation, and for Spidermon development tests, docs . At the sametime, some dependencies like itemadapter are missing.