scrapinghub / spidermon

Scrapy Extension for monitoring spiders execution.
https://spidermon.readthedocs.io
BSD 3-Clause "New" or "Revised" License
526 stars 94 forks source link

It can be difficult to confirm current spidermon thresholds for monitors #388

Closed further-reading closed 1 year ago

further-reading commented 1 year ago

We recevied from feedback that it is common for users to have difficulty confirming what a spider's current monitor thresholds are. This is due to the myriad ways these can be set:

The suggestion we have received is to include logs that state the current thresholds to make it clear to a user what targets the monitors are following.

further-reading commented 1 year ago

After discussing with the maintainer we decided this isn't under spidermon's purview as the root cause is how scrapy handles its settings. I've opted to make a extention to report on settings at runtime which will handle this use case.