scrapinghub / splash

Lightweight, scriptable browser as a service with an HTTP API
BSD 3-Clause "New" or "Revised" License
4.04k stars 508 forks source link

Website Detects "Browser Blocks Cookies" When Rendered Using Splash #1115

Open roberthng opened 3 years ago

roberthng commented 3 years ago

Hi all, I'm quite new on splash and currently try to scrape web pages that require login. I use splash because it can render javascript which is used by the website I'm trying to scrape. Whenever i try to render the website on splash the site appears to detect that the browser blocks cookies.

website: capitaliq.com image

Does anybody know how to work around with this issue? I tried using splash:init_cookies(splash.args.cookies) but it appears to not be the solution and instead returns an error. Many thanks.