Cookie handling - Githubissues

rivermont / spidy

The simple, easy to use command line web crawler.

GNU General Public License v3.0

340 stars 69 forks source link

Cookie handling #79

Open n0kovo opened 3 years ago

n0kovo commented 3 years ago

Feature Description

Some cookie handling functionality would be pretty valuable. Setting cookies in the config file should be trivial to implement. An option to send a GET or POST every n scraped URLs / minutes, and apply the recieved cookies to subsequent request would be great too. I might do a PR if I have the time in the near future.

Checklist

[x] This feature does not already exist.
[x] This feature has not been requested before.

Guthax commented 1 year ago

I would like to work on this. I know its been a while since someone contributed something to this project, but it seems like a good project which does not take too much time understanding how everything works from scratch.