Closed se-jaeger closed 2 years ago
https://github.com/calgo-lab/green-db/blob/1b88178235ffe5c58378267f6630c7ae5d6ca9f2/scraping/scraping/settings.py#L41-L43
One possibility to solve this could be to move this setting to each spider and set this explicitly.
I would go for spider specific settings 👍 You can use custom_settings for this like in asos-spider:
custom_settings
https://github.com/calgo-lab/green-db/blob/e3c89d6e2453472759edc371bbbc359fa2503025/scraping/scraping/spiders/asos.py#L37-L40
Solved by #58 and #54
https://github.com/calgo-lab/green-db/blob/1b88178235ffe5c58378267f6630c7ae5d6ca9f2/scraping/scraping/settings.py#L41-L43
One possibility to solve this could be to move this setting to each spider and set this explicitly.