hook: fetch_url

[cldellow]

fetch_url(scraper, config, url, request_headers)

Fetch an HTTP response, perhaps from a cache or from the live server.

Returns:

• None, to indicate not handled
• a response object, which is a dict like: (url, request_headers, fetched_at, response_headers, status code, body bytes)

Once any plugin has returned a truthy value, no other plugin's fetch_url hook will be invoked.