Added possibility to pass cookies as options

[spk]

This can be useful for example when you want to crawl a website logged in.

[postmodern]

It might be more useful to initialize the full CookieJar via an option.

[spk]

Yes I can watch this if you are not working in it ?

[spk]

@postmodern is this implementation ok for you ?

[postmodern]

It just occurred to me you can simply populate the cookie_jar within the setup block:

Spidr.host(...) do |agent|
  agent.cookie_jar['host'] = {...}

  agent.every_url do |url|
    ...
  end
end

[spk]

@postmodern yes it work with agent.cookies['host'] = {...} thank you.