laurentj / slimerjs

A scriptable browser like PhantomJS, based on Firefox
http://slimerjs.org
Other
3k stars 258 forks source link

Error when loading https page #700

Open javismiles opened 6 years ago

javismiles commented 6 years ago

versions

Steps to reproduce the issue

try to capture the webpage https://posterini.com

Actual results:

(website.com is in reality posterini.com)

2018-06-04T23:38:02.333Z [DEBUG] webpage: openUrl https://www.website.com conf:{operation: "get", } 2018-06-04T23:38:02.343Z [DEBUG] network: main request starting - https://www.website.com/ flags:START,IS_REQ,IS_DOC,IS_NET,IS_WIN, 2018-06-04T23:38:02.345Z [DEBUG] network: resource request #1 started: GET - https://www.website.com/ flags=DOCUMENT_URI, INITIAL_DOCUMENT_URI, 2018-06-04T23:38:02.349Z [DEBUG] network: status change for https://www.website.com/ (2152398860): Performing a TLS handshake to www.website.com… 2018-06-04T23:38:02.353Z [DEBUG] network: status change for https://www.website.com/ (2152398861): The TLS handshake finished for www.website.com… 2018-06-04T23:38:02.354Z [DEBUG] network: resource #1 response 'start': https://www.website.com/ flags=DOCUMENT_URI, INITIAL_DOCUMENT_URI, 2018-06-04T23:38:02.356Z [DEBUG] network: resource #1 response in error: #99 - an unknown network-related error was detected (2153390067) 2018-06-04T23:38:02.356Z [DEBUG] network: resource #1 response end status: https://www.website.com/ 2018-06-04T23:38:02.356Z [DEBUG] network: resource #1 response in error (3): 99 - an unknown network-related error was detected (2153390067) 2018-06-04T23:38:02.356Z [DEBUG] network: main request https://www.website.com/ flags:STOP,IS_REQ, 2018-06-04T23:38:02.356Z [DEBUG] network: main request: transfer done 2018-06-04T23:38:02.357Z [DEBUG] network: main request https://www.website.com/ flags:STOP,IS_DOC, 2018-06-04T23:38:02.357Z [DEBUG] network: main request: ignored state 2018-06-04T23:38:02.360Z [DEBUG] network: main request https://www.website.com/ flags:STOP,IS_NET,IS_WIN, 2018-06-04T23:38:02.360Z [DEBUG] network: main request: is loaded 2018-06-04T23:38:02.365Z [DEBUG] network: request ignored. main page uri not started yet - jar:file:///path/ff2/firefox/omni.ja!/chrome/toolkit/skin/classic/global/netError.css flags:START,IS_REQ, Unable to load the address!

Expected results:

It should load it with no problems

javismiles commented 6 years ago

Im using parameters --ssl-protocol=any --debug=true --headless

laurentj commented 6 years ago

Hi,

Sorry, I cannot reproduce your issue. Your script works well with Firefox 57 and SlimerJS 1.0 on my computer.

Try to load your website with Firefox directly on the same machine.

It seems you have something on your machine or your network which prevent to load the website correctly. However I don't know what. The error code is unknown and does not correspond to a specific error code from the source code of Firefox (probably a combination of some codes).

n-sharvarish commented 6 years ago

@javismiles @laurentj

This issue is occurring due to self signed certificates. You need xvfb. Refer this link: http://darrendev.blogspot.com/2013/10/slimerjs-getting-it-to-work-with-self.html