scrapinghub / portia

Visual scraping for Scrapy
BSD 3-Clause "New" or "Revised" License
9.28k stars 1.41k forks source link

Spider does not pass login cookies to Splash #664

Open brandomr opened 7 years ago

brandomr commented 7 years ago

I have noticed that I can either:

  1. execute javascript with Splash
  2. use the login feature

When I run portiacrawl verbosely while trying to do both and I simultaneously tail logs on the Splash container I see that the Spider successfully logs into the site, then passes the subsequent pages to Splash. The url is not passed to the Splash render endpoint with the session cookie, so Splash is redirected to a login page.