Not sure if there's any point doing a PR with this because it might break other requests, but I had an issue with a url giving a 403 error. Adding the above with an empty user-agent to line 484 fixed the issue.
Happy to do a PR if that helps, maybe something that tries this if the first try returns a 403.
Not sure if there's any point doing a PR with this because it might break other requests, but I had an issue with a url giving a 403 error. Adding the above with an empty user-agent to line 484 fixed the issue.
Happy to do a PR if that helps, maybe something that tries this if the first try returns a 403.