mozilla / tls-canary

DEPRECATED - TLS regression scanner for Firefox
https://tlscanary.mozilla.org/
Mozilla Public License 2.0
18 stars 15 forks source link

add dockerfile for bootstrapped ubuntu:20.04 #229

Closed g-k closed 3 years ago

g-k commented 4 years ago

Might want to rename or move it to something with ubuntu in the filename if supporting multiple OSes is important.

Example usage:

~/tls-canary » docker build -t tlscanary:latest .
... grab coffee ...
~/tls-canary » mkdir -p cache
~/tls-canary » docker run -v "$(pwd)/cache:/root/.tlscanary/cache" -it tlscanary:latest --debug regression --source top --onecrlpin origin/main -l 5
2020-09-23 17:17:44 DEBUG MainThread tlscanary.main Command arguments: Namespace(base='release', cache=False, debug=True, filter=1, limit=5, max_timeout=20, mode='regression', onecrl='production', onecrlpin='origin/main', parallel=4, prefs=None, prefs_base=None, prefs_test=None, remove_certs=False, requestsperworker=50, scans=3, source='top', test='nightly', timeout=10, workdir='/root/.tlscanary')
2020-09-23 17:17:44 DEBUG MainThread tlscanary.main Platform does not require switching terminal encoding
2020-09-23 17:17:44 DEBUG MainThread tlscanary.main Created temp dir `/tmp/tlscanary_0dvbbchb`
2020-09-23 17:17:44 DEBUG MainThread tlscanary.loader Running mode .setup()
2020-09-23 17:17:44 INFO MainThread tlscanary.modes.basemode Downloading Firefox `nightly` build for platform `linux`
2020-09-23 17:17:44 DEBUG MainThread tlscanary.tools.cache Purging stale cache entries from `/root/.tlscanary/cache`
2020-09-23 17:17:44 WARNING MainThread tlscanary.tools.firefox_downloader Skipping download, using cached file `/root/.tlscanary/cache/firefox-nightly_linux.tar.bz2` instead
2020-09-23 17:17:44 INFO MainThread tlscanary.tools.firefox_extractor Extracting Firefox archive `/root/.tlscanary/cache/firefox-nightly_linux.tar.bz2`
2020-09-23 17:17:44 DEBUG MainThread tlscanary.tools.firefox_extractor Using 7zip executable at `/usr/bin/7z`
2020-09-23 17:17:44 DEBUG MainThread tlscanary.tools.cache Purging stale cache entries from `/root/.tlscanary/cache`
2020-09-23 17:17:44 DEBUG MainThread tlscanary.modes.basemode Build candidate executable is `/root/.tlscanary/cache/firefox-nightly_linux/firefox/firefox`
2020-09-23 17:17:44 INFO MainThread tlscanary.modes.basemode Downloading Firefox `release` build for platform `linux`
2020-09-23 17:17:44 DEBUG MainThread tlscanary.tools.cache Purging stale cache entries from `/root/.tlscanary/cache`
2020-09-23 17:17:44 WARNING MainThread tlscanary.tools.firefox_downloader Skipping download, using cached file `/root/.tlscanary/cache/firefox-release_linux.tar.bz2` instead
2020-09-23 17:17:44 INFO MainThread tlscanary.tools.firefox_extractor Extracting Firefox archive `/root/.tlscanary/cache/firefox-release_linux.tar.bz2`
2020-09-23 17:17:44 DEBUG MainThread tlscanary.tools.firefox_extractor Using 7zip executable at `/usr/bin/7z`
2020-09-23 17:17:44 DEBUG MainThread tlscanary.tools.cache Purging stale cache entries from `/root/.tlscanary/cache`
2020-09-23 17:17:44 DEBUG MainThread tlscanary.modes.basemode Build candidate executable is `/root/.tlscanary/cache/firefox-release_linux/firefox/firefox`
2020-09-23 17:17:44 DEBUG MainThread tlscanary.tools.xpcshell_worker Executing worker shell command `/root/.tlscanary/cache/firefox-nightly_linux/firefox/firefox -xpcshell -g /root/.tlscanary/cache/firefox-nightly_linux/firefox/ -a /root/.tlscanary/cache/firefox-nightly_linux/firefox/browser -f /usr/local/lib/python3.8/dist-packages/tlscanary/js/worker_common.js /usr/local/lib/python3.8/dist-packages/tlscanary/js/scan_worker.js`
/usr/lib/python3.8/subprocess.py:838: RuntimeWarning: line buffering (buffering=1) isn't supported in binary mode, the default buffer size will be used
  self.stdin = io.open(p2cwrite, 'wb', bufsize)
/usr/lib/python3.8/subprocess.py:844: RuntimeWarning: line buffering (buffering=1) isn't supported in binary mode, the default buffer size will be used
  self.stdout = io.open(c2pread, 'rb', bufsize)
2020-09-23 17:17:44 DEBUG Reader tlscanary.tools.xpcshell_worker Reader thread started for worker <subprocess.Popen object at 0x7f945d4db3a0>
2020-09-23 17:17:44 DEBUG MainThread tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "info", "args": {}}`
2020-09-23 17:17:44 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":5598141211244878000,"worker_id":16170772850507231000,"original_cmd":{"id":null,"mode":"info","args":{}},"success":true,"result":{"nssInfo":{"NSPR_MinVersion":"4.29","NSS_MinVersion":"3.58 Beta","NSSUTIL_MinVersion":"3.58 Beta","NSSSSL_MinVersion":"3.58 Beta","NSSSMIME_MinVersion":"3.58 Beta","NSPR_Version":"4.29","NSS_Version":"3.58 Beta","NSSUTIL_Version":"3.58 Beta","NSSSSL_Version":"3.58 Beta","NSSSMIME_Version":"3.58 Beta"},"appConstants":{"NIGHTLY_BUILD":true,"FENNEC_NIGHTLY":false,"RELEASE_OR_BETA":false,"EARLY_BETA_OR_EARLIER":true,"ACCESSIBILITY":true,"MOZILLA_OFFICIAL":true,"MOZ_OFFICIAL_BRANDING":false,"MOZ_DEV_EDITION":false,"MOZ_SERVICES_SYNC":false,"MOZ_SERVICES_HEALTHREPORT":true,"MOZ_DATA_REPORTING":true,"MOZ_SANDBOX":true,"MOZ_TELEMETRY_REPORTING":true,"MOZ_TELEMETRY_ON_BY_DEFAULT":true,"MOZ_UPDATER":true,"MOZ_SWITCHBOARD":false,"MOZ_WEBRTC":true,"MOZ_WIDGET_GTK":true,"XP_UNIX":true,"platform":"linux","unixstyle":"linux","MOZ_CRASHREPORTER":true,"MOZ_NORMANDY":true,"MOZ_MAINTENANCE_SERVICE":false,"MOZ_UPDATE_AGENT":false,"MOZ_BITS_DOWNLOAD":false,"DEBUG":false,"ASAN":false,"ASAN_REPORTER":false,"TSAN":false,"MOZ_SYSTEM_NSS":false,"MOZ_PLACES":true,"MOZ_REQUIRE_SIGNING":false,"MOZ_UNSIGNED_SCOPES":0,"MOZ_ALLOW_ADDON_SIDELOAD":false,"MENUBAR_CAN_AUTOHIDE":true,"MOZ_ANDROID_HISTORY":false,"MOZ_GECKO_PROFILER":true,"DLL_PREFIX":"lib","DLL_SUFFIX":".so","MOZ_APP_NAME":"firefox","MOZ_APP_BASENAME":"Firefox","MOZ_APP_VERSION":"83.0a1","MOZ_APP_VERSION_DISPLAY":"83.0a1","MOZ_BUILDID":"20200923095909","MOZ_BUILD_APP":"browser","MOZ_MACBUNDLE_NAME":"Firefox Nightly.app","MOZ_UPDATE_CHANNEL":"nightly","MOZ_WIDGET_TOOLKIT":"gtk","ANDROID_PACKAGE_NAME":"org.mozilla.firefox","DEBUG_JS_MODULES":"","MOZ_BING_API_CLIENTID":"no-bing-api-clientid","MOZ_BING_API_KEY":"__STRIPPED__","MOZ_GOOGLE_LOCATION_SERVICE_API_KEY":"__STRIPPED__","MOZ_GOOGLE_SAFEBROWSING_API_KEY":"__STRIPPED__","MOZ_MOZILLA_API_KEY":"__STRIPPED__","BROWSER_CHROME_URL":"chrome://browser/content/browser.xhtml","OMNIJAR_NAME":"omni.ja","SOURCE_REVISION_URL":"https://hg.mozilla.org/mozilla-central/rev/7927a17052473b338d511c15bc940f862ee9e3e0","HAVE_USR_LIB64_DIR":false,"HAVE_SHELL_SERVICE":true,"MOZ_CODE_COVERAGE":false,"TELEMETRY_PING_FORMAT_VERSION":4,"MOZ_NEW_XULSTORE":true,"MOZ_NEW_NOTIFICATION_STORE":true,"MOZ_NEW_CERT_STORAGE":true,"ENABLE_REMOTE_AGENT":true,"MOZ_RUST_FXA_CLIENT":true,"REMOTE_SETTINGS_VERIFY_SIGNATURE":true}},"command_time":1600881464557,"response_time":1600881464558}
2020-09-23 17:17:44 DEBUG MainThread tlscanary.tools.xpcshell_worker Executing worker shell command `/root/.tlscanary/cache/firefox-release_linux/firefox/firefox -xpcshell -g /root/.tlscanary/cache/firefox-release_linux/firefox/ -a /root/.tlscanary/cache/firefox-release_linux/firefox/browser -f /usr/local/lib/python3.8/dist-packages/tlscanary/js/worker_common.js /usr/local/lib/python3.8/dist-packages/tlscanary/js/scan_worker.js`
2020-09-23 17:17:44 DEBUG Reader tlscanary.tools.xpcshell_worker Reader thread started for worker <subprocess.Popen object at 0x7f945d4dbeb0>
2020-09-23 17:17:44 DEBUG MainThread tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "info", "args": {}}`
2020-09-23 17:17:44 DEBUG Reader tlscanary.tools.xpcshell_worker Reader thread finished for worker <subprocess.Popen object at 0x7f945d4db3a0>
2020-09-23 17:17:44 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":10760120609555788000,"worker_id":4771289377101214000,"original_cmd":{"id":null,"mode":"info","args":{}},"success":true,"result":{"nssInfo":{"NSPR_MinVersion":"4.28","NSS_MinVersion":"3.56","NSSUTIL_MinVersion":"3.56","NSSSSL_MinVersion":"3.56","NSSSMIME_MinVersion":"3.56","NSPR_Version":"4.28","NSS_Version":"3.56","NSSUTIL_Version":"3.56","NSSSSL_Version":"3.56","NSSSMIME_Version":"3.56"},"appConstants":{"NIGHTLY_BUILD":false,"FENNEC_NIGHTLY":false,"RELEASE_OR_BETA":true,"EARLY_BETA_OR_EARLIER":false,"ACCESSIBILITY":true,"MOZILLA_OFFICIAL":true,"MOZ_OFFICIAL_BRANDING":true,"MOZ_DEV_EDITION":false,"MOZ_SERVICES_SYNC":false,"MOZ_SERVICES_HEALTHREPORT":true,"MOZ_DATA_REPORTING":true,"MOZ_SANDBOX":true,"MOZ_TELEMETRY_REPORTING":true,"MOZ_TELEMETRY_ON_BY_DEFAULT":false,"MOZ_UPDATER":true,"MOZ_SWITCHBOARD":false,"MOZ_WEBRTC":true,"MOZ_WIDGET_GTK":true,"XP_UNIX":true,"platform":"linux","unixstyle":"linux","MOZ_CRASHREPORTER":true,"MOZ_NORMANDY":true,"MOZ_MAINTENANCE_SERVICE":false,"MOZ_UPDATE_AGENT":false,"MOZ_BITS_DOWNLOAD":false,"DEBUG":false,"ASAN":false,"ASAN_REPORTER":false,"TSAN":false,"MOZ_SYSTEM_NSS":false,"MOZ_PLACES":true,"MOZ_REQUIRE_SIGNING":true,"MOZ_UNSIGNED_SCOPES":0,"MOZ_ALLOW_ADDON_SIDELOAD":false,"MOZ_ALLOW_LEGACY_EXTENSIONS":false,"MENUBAR_CAN_AUTOHIDE":true,"MOZ_ANDROID_HISTORY":false,"MOZ_GECKO_PROFILER":true,"DLL_PREFIX":"lib","DLL_SUFFIX":".so","MOZ_APP_NAME":"firefox","MOZ_APP_BASENAME":"Firefox","MOZ_APP_VERSION":"81.0","MOZ_APP_VERSION_DISPLAY":"81.0","MOZ_BUILDID":"20200917005511","MOZ_BUILD_APP":"browser","MOZ_MACBUNDLE_NAME":"Firefox.app","MOZ_UPDATE_CHANNEL":"release","MOZ_WIDGET_TOOLKIT":"gtk","ANDROID_PACKAGE_NAME":"org.mozilla.firefox","DEBUG_JS_MODULES":"","MOZ_BING_API_CLIENTID":"no-bing-api-clientid","MOZ_BING_API_KEY":"__STRIPPED__","MOZ_GOOGLE_LOCATION_SERVICE_API_KEY":"__STRIPPED__","MOZ_GOOGLE_SAFEBROWSING_API_KEY":"__STRIPPED__","MOZ_MOZILLA_API_KEY":"__STRIPPED__","BROWSER_CHROME_URL":"chrome://browser/content/browser.xhtml","OMNIJAR_NAME":"omni.ja","SOURCE_REVISION_URL":"https://hg.mozilla.org/releases/mozilla-release/rev/080f865dcb5a2427138f686afa8e72ba81936743","HAVE_USR_LIB64_DIR":false,"HAVE_SHELL_SERVICE":true,"MOZ_CODE_COVERAGE":false,"TELEMETRY_PING_FORMAT_VERSION":4,"MOZ_NEW_XULSTORE":false,"MOZ_NEW_NOTIFICATION_STORE":false,"MOZ_NEW_CERT_STORAGE":true,"ENABLE_REMOTE_AGENT":false,"MOZ_RUST_FXA_CLIENT":false}},"command_time":1600881464623,"response_time":1600881464623}
2020-09-23 17:17:44 INFO MainThread tlscanary.modes.basemode Updating OneCRL revocation data
2020-09-23 17:17:44 DEBUG MainThread tlscanary.tools.cache Purging stale cache entries from `/root/.tlscanary/cache`
2020-09-23 17:17:44 WARNING MainThread tlscanary.tools.one_crl_downloader Using cached OneCRL cert_storage data from `/root/.tlscanary/cache/production_cert_storage`
2020-09-23 17:17:44 DEBUG Reader tlscanary.tools.xpcshell_worker Reader thread finished for worker <subprocess.Popen object at 0x7f945d4dbeb0>
2020-09-23 17:17:44 DEBUG MainThread tlscanary.modes.basemode Writing OneCRL revocations data to `/tmp/tlscanary_0dvbbchb/test_profile/security_state/data.safe.bin`
2020-09-23 17:17:44 DEBUG MainThread tlscanary.modes.basemode Allow profile cache: False
2020-09-23 17:17:44 INFO MainThread tlscanary.modes.basemode Updating OneCRL revocation data
2020-09-23 17:17:44 DEBUG MainThread tlscanary.tools.cache Purging stale cache entries from `/root/.tlscanary/cache`
2020-09-23 17:17:44 WARNING MainThread tlscanary.tools.one_crl_downloader Using cached OneCRL cert_storage data from `/root/.tlscanary/cache/production_cert_storage`
2020-09-23 17:17:44 DEBUG MainThread tlscanary.modes.basemode Writing OneCRL revocations data to `/tmp/tlscanary_0dvbbchb/base_profile/security_state/data.safe.bin`
2020-09-23 17:17:44 DEBUG MainThread tlscanary.modes.basemode Allow profile cache: False
2020-09-23 17:17:44 DEBUG MainThread tlscanary.sources_db Indexing database resource `/usr/local/lib/python3.8/dist-packages/tlscanary/sources/top_sites.csv`
2020-09-23 17:17:44 DEBUG MainThread tlscanary.sources_db Indexing database resource `/usr/local/lib/python3.8/dist-packages/tlscanary/sources/digicert.csv`
2020-09-23 17:17:44 DEBUG MainThread tlscanary.sources_db Indexing database resource `/usr/local/lib/python3.8/dist-packages/tlscanary/sources/test_url_list.csv`
2020-09-23 17:17:44 DEBUG MainThread tlscanary.sources_db Indexing database resource `/usr/local/lib/python3.8/dist-packages/tlscanary/sources/debug.csv`
2020-09-23 17:17:44 DEBUG MainThread tlscanary.sources_db Indexing database resource `/usr/local/lib/python3.8/dist-packages/tlscanary/sources/debug2.csv`
2020-09-23 17:17:44 DEBUG MainThread tlscanary.sources_db Indexing database resource `/usr/local/lib/python3.8/dist-packages/tlscanary/sources/revoked.csv`
2020-09-23 17:17:44 DEBUG MainThread tlscanary.sources_db Indexing database resource `/usr/local/lib/python3.8/dist-packages/tlscanary/sources/smoke_list.csv`
2020-09-23 17:17:44 INFO MainThread tlscanary.modes.regression Reading `top` host database
2020-09-23 17:17:44 DEBUG MainThread tlscanary.sources_db Reading `top` sources from `/usr/local/lib/python3.8/dist-packages/tlscanary/sources/top_sites.csv`
2020-09-23 17:17:46 INFO MainThread tlscanary.modes.regression 5 hosts in test set
2020-09-23 17:17:46 DEBUG MainThread tlscanary.sources_db Indexing database resource `/usr/local/lib/python3.8/dist-packages/tlscanary/sources/top_sites.csv`
2020-09-23 17:17:46 DEBUG MainThread tlscanary.sources_db Indexing database resource `/usr/local/lib/python3.8/dist-packages/tlscanary/sources/digicert.csv`
2020-09-23 17:17:46 DEBUG MainThread tlscanary.sources_db Indexing database resource `/usr/local/lib/python3.8/dist-packages/tlscanary/sources/test_url_list.csv`
2020-09-23 17:17:46 DEBUG MainThread tlscanary.sources_db Indexing database resource `/usr/local/lib/python3.8/dist-packages/tlscanary/sources/debug.csv`
2020-09-23 17:17:46 DEBUG MainThread tlscanary.sources_db Indexing database resource `/usr/local/lib/python3.8/dist-packages/tlscanary/sources/debug2.csv`
2020-09-23 17:17:46 DEBUG MainThread tlscanary.sources_db Indexing database resource `/usr/local/lib/python3.8/dist-packages/tlscanary/sources/revoked.csv`
2020-09-23 17:17:46 DEBUG MainThread tlscanary.sources_db Indexing database resource `/usr/local/lib/python3.8/dist-packages/tlscanary/sources/smoke_list.csv`
2020-09-23 17:17:46 DEBUG MainThread tlscanary.sources_db Reading `revoked` sources from `/usr/local/lib/python3.8/dist-packages/tlscanary/sources/revoked.csv`
2020-09-23 17:17:46 DEBUG MainThread tlscanary.modes.regression 1 host(s) in revoked test set
2020-09-23 17:17:46 DEBUG MainThread worq.core enqueue tlscanary.worker_pool.scan_urls [default:d37a739b216f437aa52d9cdbba02d028]
2020-09-23 17:17:46 DEBUG Thread-1 worq.task invoke tlscanary.worker_pool.scan_urls [default:d37a739b216f437aa52d9cdbba02d028] {}
2020-09-23 17:17:46 DEBUG MainThread worq.core defer tlscanary.worker_pool.collect [default:7e1645748c874774af99ea5aa9e2d43d]
2020-09-23 17:17:46 DEBUG Thread-1 tlscanary.worker_pool scan_urls task called with [(0, 'revoked.badssl.com')]
2020-09-23 17:17:46 DEBUG Thread-1 tlscanary.tools.xpcshell_worker Executing worker shell command `/root/.tlscanary/cache/firefox-nightly_linux/firefox/firefox -xpcshell -g /root/.tlscanary/cache/firefox-nightly_linux/firefox/ -a /root/.tlscanary/cache/firefox-nightly_linux/firefox/browser -f /usr/local/lib/python3.8/dist-packages/tlscanary/js/worker_common.js /usr/local/lib/python3.8/dist-packages/tlscanary/js/scan_worker.js`
2020-09-23 17:17:46 DEBUG Reader tlscanary.tools.xpcshell_worker Reader thread started for worker <subprocess.Popen object at 0x7f945d4de280>
2020-09-23 17:17:46 DEBUG Thread-1 tlscanary.tools.xpcshell_worker Changing worker profile to `/tmp/tlscanary_0dvbbchb/test_profile`
2020-09-23 17:17:46 DEBUG Thread-1 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "useprofile", "args": {"path": "/tmp/tlscanary_0dvbbchb/test_profile"}}`
2020-09-23 17:17:46 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":3368554811085502500,"worker_id":16644415611781335000,"original_cmd":{"id":null,"mode":"useprofile","args":{"path":"/tmp/tlscanary_0dvbbchb/test_profile"}},"success":true,"result":"ACK","command_time":1600881466390,"response_time":1600881466390}
2020-09-23 17:17:46 DEBUG Thread-1 tlscanary.tools.xpcshell_worker Setting worker prefs to `['security.OCSP.enabled;0']`
2020-09-23 17:17:46 DEBUG Thread-1 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "setprefs", "args": {"prefs": ["security.OCSP.enabled;0"]}}`
2020-09-23 17:17:46 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":4468893612110350300,"worker_id":16644415611781335000,"original_cmd":{"id":null,"mode":"setprefs","args":{"prefs":["security.OCSP.enabled;0"]}},"success":true,"result":"ACK","command_time":1600881466391,"response_time":1600881466391}
2020-09-23 17:17:46 DEBUG Thread-1 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "scan", "args": {"host": "revoked.badssl.com", "rank": 0, "include_certificates": false, "timeout": 10}}`
2020-09-23 17:17:46 DEBUG Thread-1 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "wakeup", "args": {}}`
2020-09-23 17:17:46 DEBUG Thread-1 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "wakeup", "args": {}}`
2020-09-23 17:17:46 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":12238486876672440000,"worker_id":16644415611781335000,"original_cmd":{"id":null,"mode":"scan","args":{"host":"revoked.badssl.com","rank":0,"include_certificates":false,"timeout":10}},"success":true,"result":"ACK","command_time":1600881466392,"response_time":1600881466409}
2020-09-23 17:17:46 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":1231296134087049200,"worker_id":16644415611781335000,"original_cmd":{"id":null,"mode":"wakeup","args":{}},"success":true,"result":"ACK","command_time":1600881466409,"response_time":1600881466413}
2020-09-23 17:17:46 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":17526653404441704000,"worker_id":16644415611781335000,"original_cmd":{"id":null,"mode":"wakeup","args":{}},"success":true,"result":"ACK","command_time":1600881466413,"response_time":1600881466413}
2020-09-23 17:17:46 DEBUG Thread-1 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "wakeup", "args": {}}`
2020-09-23 17:17:46 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":10850276500520640000,"worker_id":16644415611781335000,"original_cmd":{"id":null,"mode":"wakeup","args":{}},"success":true,"result":"ACK","command_time":1600881466493,"response_time":1600881466494}
2020-09-23 17:17:46 DEBUG Thread-1 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "wakeup", "args": {}}`
2020-09-23 17:17:46 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":12238486876672440000,"worker_id":16644415611781335000,"original_cmd":{"id":null,"mode":"scan","args":{"host":"revoked.badssl.com","rank":0,"include_certificates":false,"timeout":10}},"success":false,"result":{"origin":"error_handler","info":{"status":2153390068,"original_uri":"https://revoked.badssl.com/","uri":"https://revoked.badssl.com/","error_class":null,"security_info_status":true,"security_state_status":true,"security_state":4,"ssl_status_status":false,"ssl_status_errors":null,"certified_usages":null,"certificate_chain_length":null,"certificate_chain":null,"error_code":-8180,"raw_error":"SEC_ERROR_REVOKED_CERTIFICATE","short_error_message":"SEC_ERROR_REVOKED_CERTIFICATE"}},"command_time":1600881466392,"response_time":1600881466598}
2020-09-23 17:17:46 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":6785338085671289000,"worker_id":16644415611781335000,"original_cmd":{"id":null,"mode":"wakeup","args":{}},"success":true,"result":"ACK","command_time":1600881466594,"response_time":1600881466607}
2020-09-23 17:17:46 DEBUG Thread-1 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "quit", "args": {}}`
2020-09-23 17:17:46 DEBUG Thread-1 tlscanary.worker_pool Worker task finished, returning 1 results
2020-09-23 17:17:46 DEBUG Thread-1 worq.core undefer [default:7e1645748c874774af99ea5aa9e2d43d]
2020-09-23 17:17:46 DEBUG Thread-1 worq.task invoke tlscanary.worker_pool.collect [default:7e1645748c874774af99ea5aa9e2d43d] {}
2020-09-23 17:17:46 DEBUG MainThread tlscanary.worker_pool After queue wait: 2 old - 0 new = 2 done
2020-09-23 17:17:46 DEBUG MainThread tlscanary.worker_pool Stopping worker pool <worq.pool.thread.WorkerPool object at 0x7f945d5292b0>
2020-09-23 17:17:46 DEBUG Reader tlscanary.tools.xpcshell_worker Reader thread finished for worker <subprocess.Popen object at 0x7f945d4de280>
2020-09-23 17:17:47 INFO MainThread tlscanary.modes.basemode Updating OneCRL revocation data
2020-09-23 17:17:47 DEBUG MainThread tlscanary.modes.basemode Deleting existing data.safe.bin file
2020-09-23 17:17:47 DEBUG MainThread tlscanary.modes.basemode Allow profile cache: False
2020-09-23 17:17:47 DEBUG MainThread worq.core enqueue tlscanary.worker_pool.scan_urls [default:053d7b0976e54b2f83f9926bb523c4ad]
2020-09-23 17:17:47 DEBUG MainThread worq.core defer tlscanary.worker_pool.collect [default:59b2b200fda14d68a4931187bed8312c]
2020-09-23 17:17:47 DEBUG Thread-2 worq.task invoke tlscanary.worker_pool.scan_urls [default:053d7b0976e54b2f83f9926bb523c4ad] {}
2020-09-23 17:17:47 DEBUG Thread-2 tlscanary.worker_pool scan_urls task called with [(0, 'revoked.badssl.com')]
2020-09-23 17:17:47 DEBUG Thread-2 tlscanary.tools.xpcshell_worker Executing worker shell command `/root/.tlscanary/cache/firefox-nightly_linux/firefox/firefox -xpcshell -g /root/.tlscanary/cache/firefox-nightly_linux/firefox/ -a /root/.tlscanary/cache/firefox-nightly_linux/firefox/browser -f /usr/local/lib/python3.8/dist-packages/tlscanary/js/worker_common.js /usr/local/lib/python3.8/dist-packages/tlscanary/js/scan_worker.js`
2020-09-23 17:17:47 DEBUG Reader tlscanary.tools.xpcshell_worker Reader thread started for worker <subprocess.Popen object at 0x7f945d4de910>
2020-09-23 17:17:47 DEBUG Thread-2 tlscanary.tools.xpcshell_worker Changing worker profile to `/tmp/tlscanary_0dvbbchb/altered_profile`
2020-09-23 17:17:47 DEBUG Thread-2 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "useprofile", "args": {"path": "/tmp/tlscanary_0dvbbchb/altered_profile"}}`
2020-09-23 17:17:47 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":8009494385823605000,"worker_id":2932294247930890000,"original_cmd":{"id":null,"mode":"useprofile","args":{"path":"/tmp/tlscanary_0dvbbchb/altered_profile"}},"success":true,"result":"ACK","command_time":1600881467780,"response_time":1600881467781}
2020-09-23 17:17:47 DEBUG Thread-2 tlscanary.tools.xpcshell_worker Setting worker prefs to `['security.OCSP.enabled;0']`
2020-09-23 17:17:47 DEBUG Thread-2 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "setprefs", "args": {"prefs": ["security.OCSP.enabled;0"]}}`
2020-09-23 17:17:47 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":2075422518089664500,"worker_id":2932294247930890000,"original_cmd":{"id":null,"mode":"setprefs","args":{"prefs":["security.OCSP.enabled;0"]}},"success":true,"result":"ACK","command_time":1600881467781,"response_time":1600881467782}
2020-09-23 17:17:47 DEBUG Thread-2 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "scan", "args": {"host": "revoked.badssl.com", "rank": 0, "include_certificates": false, "timeout": 10}}`
2020-09-23 17:17:47 DEBUG Thread-2 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "wakeup", "args": {}}`
2020-09-23 17:17:47 DEBUG Thread-2 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "wakeup", "args": {}}`
2020-09-23 17:17:47 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":484447625308790800,"worker_id":2932294247930890000,"original_cmd":{"id":null,"mode":"scan","args":{"host":"revoked.badssl.com","rank":0,"include_certificates":false,"timeout":10}},"success":true,"result":"ACK","command_time":1600881467782,"response_time":1600881467799}
2020-09-23 17:17:47 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":1708706884431280000,"worker_id":2932294247930890000,"original_cmd":{"id":null,"mode":"wakeup","args":{}},"success":true,"result":"ACK","command_time":1600881467799,"response_time":1600881467803}
2020-09-23 17:17:47 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":15788753320490353000,"worker_id":2932294247930890000,"original_cmd":{"id":null,"mode":"wakeup","args":{}},"success":true,"result":"ACK","command_time":1600881467803,"response_time":1600881467803}
2020-09-23 17:17:47 DEBUG Thread-2 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "wakeup", "args": {}}`
2020-09-23 17:17:47 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":8268478874206605000,"worker_id":2932294247930890000,"original_cmd":{"id":null,"mode":"wakeup","args":{}},"success":true,"result":"ACK","command_time":1600881467883,"response_time":1600881467883}
2020-09-23 17:17:47 DEBUG Thread-2 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "wakeup", "args": {}}`
2020-09-23 17:17:47 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":15571839374006966000,"worker_id":2932294247930890000,"original_cmd":{"id":null,"mode":"wakeup","args":{}},"success":true,"result":"ACK","command_time":1600881467984,"response_time":1600881467985}
2020-09-23 17:17:48 DEBUG Thread-2 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "wakeup", "args": {}}`
2020-09-23 17:17:48 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":484447625308790800,"worker_id":2932294247930890000,"original_cmd":{"id":null,"mode":"scan","args":{"host":"revoked.badssl.com","rank":0,"include_certificates":false,"timeout":10}},"success":true,"result":{"origin":"load_handler","info":{"status":0,"original_uri":"https://revoked.badssl.com/","uri":"https://revoked.badssl.com/","error_class":null,"security_info_status":true,"security_state_status":true,"security_state":2,"ssl_status_status":false,"ssl_status_errors":null,"certified_usages":null,"certificate_chain_length":null,"certificate_chain":null,"error_code":0,"raw_error":"","short_error_message":""}},"command_time":1600881467782,"response_time":1600881468090}
2020-09-23 17:17:48 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":6401981995159339000,"worker_id":2932294247930890000,"original_cmd":{"id":null,"mode":"wakeup","args":{}},"success":true,"result":"ACK","command_time":1600881468085,"response_time":1600881468090}
2020-09-23 17:17:48 DEBUG Thread-2 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "quit", "args": {}}`
2020-09-23 17:17:48 DEBUG Thread-2 tlscanary.worker_pool Worker task finished, returning 1 results
2020-09-23 17:17:48 DEBUG Thread-2 worq.core undefer [default:59b2b200fda14d68a4931187bed8312c]
2020-09-23 17:17:48 DEBUG Thread-2 worq.task invoke tlscanary.worker_pool.collect [default:59b2b200fda14d68a4931187bed8312c] {}
2020-09-23 17:17:48 DEBUG MainThread tlscanary.worker_pool After queue wait: 2 old - 0 new = 2 done
2020-09-23 17:17:48 DEBUG MainThread tlscanary.worker_pool Stopping worker pool <worq.pool.thread.WorkerPool object at 0x7f945d529190>
2020-09-23 17:17:48 DEBUG Reader tlscanary.tools.xpcshell_worker Reader thread finished for worker <subprocess.Popen object at 0x7f945d4de910>
2020-09-23 17:17:49 DEBUG MainThread tlscanary.modes.regression Length of first OneCRL check, with revocation: 1
2020-09-23 17:17:49 DEBUG MainThread tlscanary.modes.regression Length of second OneCRL check, without revocation: 0
2020-09-23 17:17:49 DEBUG MainThread tlscanary.loader Running mode .run()
2020-09-23 17:17:49 INFO MainThread tlscanary.modes.regression Testing Firefox 83.0a1 nightly against Firefox 81.0 release
2020-09-23 17:17:49 DEBUG MainThread tlscanary.runlog Opening run log file `/root/.tlscanary/log/2020/09/2020-09-23Z17-17-49/log.bz2` in mode `w`
2020-09-23 17:17:49 DEBUG MainThread tlscanary.runlog Opening run log file `/root/.tlscanary/log/2020/09/2020-09-23Z17-17-49/meta` in mode `w`
2020-09-23 17:17:49 INFO MainThread tlscanary.modes.regression Starting regression run on chunk of 5 hosts
2020-09-23 17:17:49 DEBUG MainThread worq.core enqueue tlscanary.worker_pool.scan_urls [default:78ae211ba5ac4982b72b3a2593c9c052]
2020-09-23 17:17:49 DEBUG Thread-3 worq.task invoke tlscanary.worker_pool.scan_urls [default:78ae211ba5ac4982b72b3a2593c9c052] {}
2020-09-23 17:17:49 DEBUG Thread-3 tlscanary.worker_pool scan_urls task called with [(1, 'google.com'), (3, 'netflix.com'), (4, 'facebook.com'), (6, 'microsoft.com'), (2, 'youtube.com')]
2020-09-23 17:17:49 DEBUG MainThread worq.core defer tlscanary.worker_pool.collect [default:2fecc559d1564e3d9636ea9f67d4efdc]
2020-09-23 17:17:49 DEBUG Thread-3 tlscanary.tools.xpcshell_worker Executing worker shell command `/root/.tlscanary/cache/firefox-nightly_linux/firefox/firefox -xpcshell -g /root/.tlscanary/cache/firefox-nightly_linux/firefox/ -a /root/.tlscanary/cache/firefox-nightly_linux/firefox/browser -f /usr/local/lib/python3.8/dist-packages/tlscanary/js/worker_common.js /usr/local/lib/python3.8/dist-packages/tlscanary/js/scan_worker.js`
2020-09-23 17:17:49 DEBUG Reader tlscanary.tools.xpcshell_worker Reader thread started for worker <subprocess.Popen object at 0x7f945d4d3d30>
2020-09-23 17:17:49 DEBUG Thread-3 tlscanary.tools.xpcshell_worker Changing worker profile to `/tmp/tlscanary_0dvbbchb/test_profile`
2020-09-23 17:17:49 DEBUG Thread-3 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "useprofile", "args": {"path": "/tmp/tlscanary_0dvbbchb/test_profile"}}`
2020-09-23 17:17:49 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":13526294951549385000,"worker_id":12127829713001884000,"original_cmd":{"id":null,"mode":"useprofile","args":{"path":"/tmp/tlscanary_0dvbbchb/test_profile"}},"success":true,"result":"ACK","command_time":1600881469264,"response_time":1600881469264}
2020-09-23 17:17:49 DEBUG Thread-3 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "scan", "args": {"host": "google.com", "rank": 1, "include_certificates": false, "timeout": 10}}`
2020-09-23 17:17:49 DEBUG Thread-3 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "wakeup", "args": {}}`
2020-09-23 17:17:49 DEBUG Thread-3 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "scan", "args": {"host": "netflix.com", "rank": 3, "include_certificates": false, "timeout": 10}}`
2020-09-23 17:17:49 DEBUG Thread-3 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "scan", "args": {"host": "facebook.com", "rank": 4, "include_certificates": false, "timeout": 10}}`
2020-09-23 17:17:49 DEBUG Thread-3 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "scan", "args": {"host": "microsoft.com", "rank": 6, "include_certificates": false, "timeout": 10}}`
2020-09-23 17:17:49 DEBUG Thread-3 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "scan", "args": {"host": "youtube.com", "rank": 2, "include_certificates": false, "timeout": 10}}`
2020-09-23 17:17:49 DEBUG Thread-3 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "wakeup", "args": {}}`
2020-09-23 17:17:49 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":11716587670512316000,"worker_id":12127829713001884000,"original_cmd":{"id":null,"mode":"scan","args":{"host":"google.com","rank":1,"include_certificates":false,"timeout":10}},"success":true,"result":"ACK","command_time":1600881469265,"response_time":1600881469282}
2020-09-23 17:17:49 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":1256678917856045000,"worker_id":12127829713001884000,"original_cmd":{"id":null,"mode":"wakeup","args":{}},"success":true,"result":"ACK","command_time":1600881469282,"response_time":1600881469286}
2020-09-23 17:17:49 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":11690215077139257000,"worker_id":12127829713001884000,"original_cmd":{"id":null,"mode":"scan","args":{"host":"netflix.com","rank":3,"include_certificates":false,"timeout":10}},"success":true,"result":"ACK","command_time":1600881469286,"response_time":1600881469287}
2020-09-23 17:17:49 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":8742601651205005000,"worker_id":12127829713001884000,"original_cmd":{"id":null,"mode":"scan","args":{"host":"facebook.com","rank":4,"include_certificates":false,"timeout":10}},"success":true,"result":"ACK","command_time":1600881469287,"response_time":1600881469287}
2020-09-23 17:17:49 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":3236588465032257500,"worker_id":12127829713001884000,"original_cmd":{"id":null,"mode":"scan","args":{"host":"microsoft.com","rank":6,"include_certificates":false,"timeout":10}},"success":true,"result":"ACK","command_time":1600881469287,"response_time":1600881469288}
2020-09-23 17:17:49 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":14435236351073010000,"worker_id":12127829713001884000,"original_cmd":{"id":null,"mode":"scan","args":{"host":"youtube.com","rank":2,"include_certificates":false,"timeout":10}},"success":true,"result":"ACK","command_time":1600881469288,"response_time":1600881469288}
2020-09-23 17:17:49 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":11901330985969840000,"worker_id":12127829713001884000,"original_cmd":{"id":null,"mode":"wakeup","args":{}},"success":true,"result":"ACK","command_time":1600881469288,"response_time":1600881469288}
2020-09-23 17:17:49 DEBUG Thread-3 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "wakeup", "args": {}}`
2020-09-23 17:17:49 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":4011668464345649000,"worker_id":12127829713001884000,"original_cmd":{"id":null,"mode":"wakeup","args":{}},"success":true,"result":"ACK","command_time":1600881469367,"response_time":1600881469369}
2020-09-23 17:17:49 DEBUG Thread-3 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "wakeup", "args": {}}`
2020-09-23 17:17:49 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":602451751603920900,"worker_id":12127829713001884000,"original_cmd":{"id":null,"mode":"wakeup","args":{}},"success":true,"result":"ACK","command_time":1600881469468,"response_time":1600881469471}
2020-09-23 17:17:49 DEBUG Thread-3 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "wakeup", "args": {}}`
2020-09-23 17:17:49 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":4845749036442558000,"worker_id":12127829713001884000,"original_cmd":{"id":null,"mode":"wakeup","args":{}},"success":true,"result":"ACK","command_time":1600881469569,"response_time":1600881469575}
2020-09-23 17:17:49 DEBUG Thread-3 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "wakeup", "args": {}}`
2020-09-23 17:17:49 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":8232418150156909000,"worker_id":12127829713001884000,"original_cmd":{"id":null,"mode":"wakeup","args":{}},"success":true,"result":"ACK","command_time":1600881469670,"response_time":1600881469671}
2020-09-23 17:17:49 DEBUG Thread-3 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "wakeup", "args": {}}`
2020-09-23 17:17:49 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":13141247164419252000,"worker_id":12127829713001884000,"original_cmd":{"id":null,"mode":"wakeup","args":{}},"success":true,"result":"ACK","command_time":1600881469771,"response_time":1600881469771}
2020-09-23 17:17:49 DEBUG Thread-3 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "wakeup", "args": {}}`
2020-09-23 17:17:49 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":15777122641971650000,"worker_id":12127829713001884000,"original_cmd":{"id":null,"mode":"wakeup","args":{}},"success":true,"result":"ACK","command_time":1600881469872,"response_time":1600881469872}
2020-09-23 17:17:49 DEBUG Thread-3 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "wakeup", "args": {}}`
2020-09-23 17:17:49 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":8921471080101552000,"worker_id":12127829713001884000,"original_cmd":{"id":null,"mode":"wakeup","args":{}},"success":true,"result":"ACK","command_time":1600881469973,"response_time":1600881469973}
2020-09-23 17:17:50 DEBUG Thread-3 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "wakeup", "args": {}}`
2020-09-23 17:17:50 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":15685210619891896000,"worker_id":12127829713001884000,"original_cmd":{"id":null,"mode":"wakeup","args":{}},"success":true,"result":"ACK","command_time":1600881470074,"response_time":1600881470074}
2020-09-23 17:17:50 DEBUG Thread-3 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "wakeup", "args": {}}`
2020-09-23 17:17:50 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":3879024701442435000,"worker_id":12127829713001884000,"original_cmd":{"id":null,"mode":"wakeup","args":{}},"success":true,"result":"ACK","command_time":1600881470175,"response_time":1600881470175}
2020-09-23 17:17:50 DEBUG Thread-3 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "wakeup", "args": {}}`
2020-09-23 17:17:50 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":5981708611968969000,"worker_id":12127829713001884000,"original_cmd":{"id":null,"mode":"wakeup","args":{}},"success":true,"result":"ACK","command_time":1600881470276,"response_time":1600881470276}
2020-09-23 17:17:50 DEBUG Thread-3 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "wakeup", "args": {}}`
2020-09-23 17:17:50 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":5587326931091139000,"worker_id":12127829713001884000,"original_cmd":{"id":null,"mode":"wakeup","args":{}},"success":true,"result":"ACK","command_time":1600881470377,"response_time":1600881470377}
2020-09-23 17:17:50 DEBUG Thread-3 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "wakeup", "args": {}}`
2020-09-23 17:17:50 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":3699184391929653000,"worker_id":12127829713001884000,"original_cmd":{"id":null,"mode":"wakeup","args":{}},"success":true,"result":"ACK","command_time":1600881470478,"response_time":1600881470478}
2020-09-23 17:17:50 DEBUG Thread-3 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "wakeup", "args": {}}`
2020-09-23 17:17:50 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":4850158131865340000,"worker_id":12127829713001884000,"original_cmd":{"id":null,"mode":"wakeup","args":{}},"success":true,"result":"ACK","command_time":1600881470580,"response_time":1600881470580}
2020-09-23 17:17:50 DEBUG Thread-3 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "wakeup", "args": {}}`
2020-09-23 17:17:50 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":11690215077139257000,"worker_id":12127829713001884000,"original_cmd":{"id":null,"mode":"scan","args":{"host":"netflix.com","rank":3,"include_certificates":false,"timeout":10}},"success":true,"result":{"origin":"load_handler","info":{"status":0,"original_uri":"https://netflix.com/","uri":"https://netflix.com/","error_class":null,"security_info_status":true,"security_state_status":true,"security_state":2,"ssl_status_status":false,"ssl_status_errors":null,"certified_usages":null,"certificate_chain_length":null,"certificate_chain":null,"error_code":0,"raw_error":"","short_error_message":""}},"command_time":1600881469286,"response_time":1600881470685}
2020-09-23 17:17:50 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":11716587670512316000,"worker_id":12127829713001884000,"original_cmd":{"id":null,"mode":"scan","args":{"host":"google.com","rank":1,"include_certificates":false,"timeout":10}},"success":false,"result":{"origin":"error_handler","info":{"status":0,"original_uri":"https://google.com/","uri":"https://google.com/","error_class":null,"security_info_status":true,"security_state_status":true,"security_state":2,"ssl_status_status":false,"ssl_status_errors":null,"certified_usages":null,"certificate_chain_length":null,"certificate_chain":null,"error_code":0,"raw_error":"","short_error_message":""}},"command_time":1600881469265,"response_time":1600881470692}
2020-09-23 17:17:50 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":8742601651205005000,"worker_id":12127829713001884000,"original_cmd":{"id":null,"mode":"scan","args":{"host":"facebook.com","rank":4,"include_certificates":false,"timeout":10}},"success":false,"result":{"origin":"error_handler","info":{"status":0,"original_uri":"https://facebook.com/","uri":"https://facebook.com/","error_class":null,"security_info_status":true,"security_state_status":true,"security_state":2,"ssl_status_status":false,"ssl_status_errors":null,"certified_usages":null,"certificate_chain_length":null,"certificate_chain":null,"error_code":0,"raw_error":"","short_error_message":""}},"command_time":1600881469287,"response_time":1600881470693}
2020-09-23 17:17:50 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":14435236351073010000,"worker_id":12127829713001884000,"original_cmd":{"id":null,"mode":"scan","args":{"host":"youtube.com","rank":2,"include_certificates":false,"timeout":10}},"success":false,"result":{"origin":"error_handler","info":{"status":0,"original_uri":"https://youtube.com/","uri":"https://youtube.com/","error_class":null,"security_info_status":true,"security_state_status":true,"security_state":2,"ssl_status_status":false,"ssl_status_errors":null,"certified_usages":null,"certificate_chain_length":null,"certificate_chain":null,"error_code":0,"raw_error":"","short_error_message":""}},"command_time":1600881469288,"response_time":1600881470694}
2020-09-23 17:17:50 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":3236588465032257500,"worker_id":12127829713001884000,"original_cmd":{"id":null,"mode":"scan","args":{"host":"microsoft.com","rank":6,"include_certificates":false,"timeout":10}},"success":false,"result":{"origin":"error_handler","info":{"status":0,"original_uri":"https://microsoft.com/","uri":"https://microsoft.com/","error_class":null,"security_info_status":true,"security_state_status":true,"security_state":2,"ssl_status_status":false,"ssl_status_errors":null,"certified_usages":null,"certificate_chain_length":null,"certificate_chain":null,"error_code":0,"raw_error":"","short_error_message":""}},"command_time":1600881469287,"response_time":1600881470695}
2020-09-23 17:17:50 DEBUG Reader tlscanary.tools.xpcshell_worker Received worker message: {"id":5437429742954199000,"worker_id":12127829713001884000,"original_cmd":{"id":null,"mode":"wakeup","args":{}},"success":true,"result":"ACK","command_time":1600881470680,"response_time":1600881470696}
2020-09-23 17:17:50 DEBUG Thread-3 tlscanary.worker_pool Ignored redirect by `https://google.com/`
2020-09-23 17:17:50 DEBUG Thread-3 tlscanary.worker_pool Ignored redirect by `https://facebook.com/`
2020-09-23 17:17:50 DEBUG Thread-3 tlscanary.worker_pool Ignored redirect by `https://youtube.com/`
2020-09-23 17:17:50 DEBUG Thread-3 tlscanary.worker_pool Ignored redirect by `https://microsoft.com/`
2020-09-23 17:17:50 DEBUG Thread-3 tlscanary.tools.xpcshell_worker Sending worker message: `{"id": null, "mode": "quit", "args": {}}`
2020-09-23 17:17:50 DEBUG Thread-3 tlscanary.worker_pool Worker task finished, returning 5 results
2020-09-23 17:17:50 DEBUG Thread-3 worq.core undefer [default:2fecc559d1564e3d9636ea9f67d4efdc]
2020-09-23 17:17:50 DEBUG Thread-3 worq.task invoke tlscanary.worker_pool.collect [default:2fecc559d1564e3d9636ea9f67d4efdc] {}
2020-09-23 17:17:50 DEBUG MainThread tlscanary.worker_pool After queue wait: 2 old - 0 new = 2 done
2020-09-23 17:17:50 DEBUG MainThread tlscanary.worker_pool Stopping worker pool <worq.pool.thread.WorkerPool object at 0x7f945d4d7f70>
2020-09-23 17:17:50 DEBUG Reader tlscanary.tools.xpcshell_worker Reader thread finished for worker <subprocess.Popen object at 0x7f945d4d3d30>
2020-09-23 17:17:51 DEBUG MainThread tlscanary.worker_pool Chunkwise logging reported on 0 results, actually received 5
2020-09-23 17:17:51 DEBUG MainThread tlscanary.worker_pool Logging correction for 5 results
2020-09-23 17:17:51 INFO MainThread tlscanary.modes.regression Scan #1 with test candidate yielded 0 error hosts
2020-09-23 17:17:51 DEBUG MainThread tlscanary.modes.regression Scan #1 test candidate errors: 
2020-09-23 17:17:51 DEBUG MainThread worq.core enqueue tlscanary.worker_pool.collect [default:4f699efafba2458f958106a8504eb6d2]
2020-09-23 17:17:51 DEBUG Thread-7 worq.task invoke tlscanary.worker_pool.collect [default:4f699efafba2458f958106a8504eb6d2] {}
2020-09-23 17:17:51 DEBUG MainThread tlscanary.worker_pool After queue wait: 1 old - 0 new = 1 done
2020-09-23 17:17:51 DEBUG MainThread tlscanary.worker_pool Stopping worker pool <worq.pool.thread.WorkerPool object at 0x7f945d5364c0>
2020-09-23 17:17:52 DEBUG MainThread tlscanary.worker_pool Chunkwise logging reported on 0 results, actually received 0
2020-09-23 17:17:52 INFO MainThread tlscanary.modes.regression Scan #1 with baseline candidate yielded 0 error hosts
2020-09-23 17:17:52 DEBUG MainThread tlscanary.modes.regression Scan #1 baseline candidate errors: 
2020-09-23 17:17:52 DEBUG MainThread tlscanary.modes.regression Extracting runtime information from 0 hosts
2020-09-23 17:17:52 DEBUG MainThread worq.core enqueue tlscanary.worker_pool.collect [default:997e276f955846938d477239ee677972]
2020-09-23 17:17:52 DEBUG Thread-11 worq.task invoke tlscanary.worker_pool.collect [default:997e276f955846938d477239ee677972] {}
2020-09-23 17:17:52 DEBUG MainThread tlscanary.worker_pool After queue wait: 1 old - 0 new = 1 done
2020-09-23 17:17:52 DEBUG MainThread tlscanary.worker_pool Stopping worker pool <worq.pool.thread.WorkerPool object at 0x7f945d536670>
2020-09-23 17:17:53 DEBUG MainThread tlscanary.worker_pool Chunkwise logging reported on 0 results, actually received 0
2020-09-23 17:17:53 INFO MainThread tlscanary.modes.regression Progress: 100% 5/5, 0% overhead, -- hosts/s net, -- hosts/s gross, ETA --
2020-09-23 17:17:53 DEBUG MainThread tlscanary.modes.basemode Saving `test_profile` profile from `/tmp/tlscanary_0dvbbchb/test_profile` to `/root/.tlscanary/log/2020/09/2020-09-23Z17-17-49/test_profile.zip`
2020-09-23 17:17:53 DEBUG MainThread tlscanary.modes.basemode Saving `base_profile` profile from `/tmp/tlscanary_0dvbbchb/base_profile` to `/root/.tlscanary/log/2020/09/2020-09-23Z17-17-49/base_profile.zip`
2020-09-23 17:17:53 DEBUG MainThread tlscanary.modes.basemode Saving `altered_profile` profile from `/tmp/tlscanary_0dvbbchb/altered_profile` to `/root/.tlscanary/log/2020/09/2020-09-23Z17-17-49/altered_profile.zip`
2020-09-23 17:17:53 DEBUG MainThread tlscanary.loader Running mode .teardown()
2020-09-23 17:17:53 DEBUG MainThread tlscanary.loader Mode finished
2020-09-23 17:17:53 DEBUG MainThread tlscanary.main Removing temp dir `/tmp/tlscanary_0dvbbchb`