search

ScrapeOps / scrapeops-scrapy-sdk

Scrapy extension that gives you all the scraping monitoring, alerting, scheduling, and data validation you will need straight out of the box.
https://scrapeops.io/
BSD 3-Clause "New" or "Revised" License
37 stars 9 forks source link

Conflict with "scrapy-cookies" #11

Open artplan1 opened 12 months ago

artplan1 commented 12 months ago

Hi!

We're using https://github.com/scrapedia/scrapy-cookies for cookies persistence.

They add multiple default settings, but there is one that prevents scrapeops-scrapy-sdk from sending setup request

COOKIES_MONGO_MONGOCLIENT_DOCUMENT_CLASS = dict

I have no idea why this is happening, but it's easy to reproduce (even without scrapy_cookies) if you add line above to settings.py