search

chromium / web-page-replay

DEPRECATED - Use WebPageReplayGo instead:
https://github.com/catapult-project/catapult/blob/master/web_page_replay_go/README.md
Apache License 2.0
235 stars 75 forks source link

404 not found during record mode #81

Open rzambre opened 8 years ago

rzambre commented 8 years ago

OS: OS X 10.11 & Ubuntu 14.04 Command:

sudo ./replay.py --record ~/archive.wpr

Whenever I try to open a web page, I see the "404 not found" page on the browser. I'm using http://www.ehow.com instead of https://www.ehow.com.

I googled the solution to this but wasn't able to find anything concrete. This thread shows the problem has been fixed but I'm not seeing it work on my machine. Anything extra I need to do apart from simply cloning the repo on my Mac?

nedn commented 8 years ago

can you rerun this with "--log_level==warning" & show me the failure log?

rzambre commented 7 years ago

With "--log_level=warning" I get a bunch of the Error messages (only 2 showed here) followed by these Warnings:

(ERROR) 2016-09-09 09:37:44,870 httpproxy.get_request:374 Number of active connections (557) surpasses the supported limit of 500. (ERROR) 2016-09-09 09:37:44,871 httpproxy.get_request:374 Number of active connections (558) surpasses the supported limit of 500. (WARNING) 2016-09-09 09:37:44,873 httpclient.call:360 Retrying fetch GET http://www.food.com/ [('accept-encoding', 'gzip,deflate'), ('host', 'www.food.com'), ('upgrade-insecure-requests', '1')]: gaierror(8, 'nodename nor servname provided, or not known') (WARNING) 2016-09-09 09:37:44,874 httpclient.call:360 Retrying fetch GET http://www.food.com/ [('accept-encoding', 'gzip,deflate'), ('host', 'www.food.com'), ('upgrade-insecure-requests', '1')]: gaierror(8, 'nodename nor servname provided, or not known') (WARNING) 2016-09-09 09:37:44,874 httpclient.call:360 Retrying fetch GET http://www.food.com/ [('accept-encoding', 'gzip,deflate'), ('host', 'www.food.com'), ('upgrade-insecure-requests', '1')]: gaierror(8, 'nodename nor servname provided, or not known') (CRITICAL) 2016-09-09 09:37:44,875 httpclient.call:362 Could not fetch GET http://www.food.com/ [('accept-encoding', 'gzip,deflate'), ('host', 'www.food.com'), ('upgrade-insecure-requests', '1')]: gaierror(8, 'nodename nor servname provided, or not known') (WARNING) 2016-09-09 09:37:44,875 httpproxy.do_parse_and_handle_one_request:266 Failed to find response for: GET http://www.food.com/ ('accept-encoding', 'gzip,deflate'), ('host', 'www.food.com'), ('upgrade-insecure-requests', '1')

etipton commented 7 years ago

FYI, I'm having this same issue. DNS resolving isn't actually going out to the proper server in "record mode".

I am working around it by using the "-x" option (no-dns_forwarding) and manually specifying the (localhost) proxy server for the requests I want to record.

e.g. curl -x 127.0.0.1:80 http://example.com

(In curl, the arg for specifying an http proxy is also "-x")