search

TeamHG-Memex / autologin-middleware

Scrapy middleware for the autologin
37 stars 15 forks source link

Callback and errback are erased from retried request #6

Closed lopuhin closed 8 years ago

lopuhin commented 8 years ago

On this line: https://github.com/TeamHG-Memex/autologin-middleware/blob/64265fac56f51557880be0f7e3cc44f2b30c43c9/autologin_middleware/middleware.py#L78 They should be preserved. Originally I deleted them because they failed to serialize as part for request.meta when using a disk cache. So a different approach is required.

lopuhin commented 8 years ago

Before I forget about it - probably it's worth checking if the problem is specific to scrapy-splash, and if yes, then maybe it can be solved there.