search

apify / got-scraping

HTTP client made for scraping based on got.
526 stars 40 forks source link

fix: browser defaults #48

Closed szmarczak closed 3 years ago

szmarczak commented 3 years ago

This introduces a session storage hook which allows us to store data specific for this session :)

szmarczak commented 3 years ago

@metalwarrior665 Every session will also have its own cookie jar so they can be stored automatically :)

metalwarrior665 commented 3 years ago

@szmarczak Haha, I don't want to get into another complexity of having sessions also inside got-scraping :D But will check it over time where it would be preferable over handling them on the SDK level

szmarczak commented 3 years ago

I don't want to get into another complexity of having sessions also inside got-scraping

The session in got-scraping is directly attached to the session in SDK. These sessions have different purpose. The session in got-scraping is responsible for imitating a browser session - ciphers, headers, cookies, etc.

szmarczak commented 3 years ago

Reverted cookieJar and fixed ecdhCurve (can be used now).