Open bonesoul opened 8 years ago
I think you can write your own driver, in which you can set the useragent. Taking a look at the default http driver should help. https://github.com/lapwinglabs/x-ray-crawler/blob/master/lib/http-driver.js
Note that this is a duplicate of #168
is there a way we can set our own user-agent during requests? couldn't find an example