Closed ShaneHarvey closed 4 years ago
I had to revert this change because it's causing these failures on Windows:
[2020/02/26 12:45:05.619] + curl --silent --show-error --data @C:/data/mci/4a8e5e162474e3a7efd75360b86dfa07/drivers-tools/.evergreen/orchestration/configs/servers/auth.json http://localhost:8889/v1/servers --max-time 600 --fail -o tmp.json
[2020/02/26 12:45:05.822] curl: (22) The requested URL returned error: 500 Internal Server Error
[2020/02/26 12:45:05.822] Failed to start cluster, see C:/data/mci/4a8e5e162474e3a7efd75360b86dfa07/drivers-tools/.evergreen/orchestration/out.log:
[2020/02/26 12:45:05.822] + echo Failed to start cluster, see C:/data/mci/4a8e5e162474e3a7efd75360b86dfa07/drivers-tools/.evergreen/orchestration/out.log:
[2020/02/26 12:45:05.822] + cat C:/data/mci/4a8e5e162474e3a7efd75360b86dfa07/drivers-tools/.evergreen/orchestration/out.log
[2020/02/26 12:45:05.822] Preparing to start mongo-orchestration daemon
[2020/02/26 12:45:05.822] Daemon process started with pid: 3320
[2020/02/26 12:45:05.822] + echo Failed to start cluster, see C:/data/mci/4a8e5e162474e3a7efd75360b86dfa07/drivers-tools/.evergreen/orchestration/server.log:
[2020/02/26 12:45:05.822] Failed to start cluster, see C:/data/mci/4a8e5e162474e3a7efd75360b86dfa07/drivers-tools/.evergreen/orchestration/server.log:
[2020/02/26 12:45:05.822] + cat C:/data/mci/4a8e5e162474e3a7efd75360b86dfa07/drivers-tools/.evergreen/orchestration/server.log
[2020/02/26 12:45:05.856] From shell Wed, Feb 26, 2020 8:44:44 PM
[2020/02/26 12:45:05.856] 2020-02-26 20:44:54,789 [INFO] mongo_orchestration.daemon:132 - Starting daemon
[2020/02/26 12:45:05.856] 2020-02-26 20:44:54,789 [INFO] mongo_orchestration.daemon:57 - daemonize_win32: ['C:\\data\\mci\\4a8e5e162474e3a7efd75360b86dfa07\\drivers-tools\\.evergreen\\orchestration\\venv\\Scripts\\mongo-orchestration', '-e', 'default', '-f', 'C:/data/mci/4a8e5e162474e3a7efd75360b86dfa07/drivers-tools/.evergreen/orchestration/orchestration.config', '--socket-timeout-ms=60000', '--bind=127.0.0.1', '--enable-majority-read-concern', '-s', 'wsgiref', 'start']
[2020/02/26 12:45:05.856] 2020-02-26 20:44:54,930 [DEBUG] mongo_orchestration.server:182 - Starting mongo-orchestration in the foreground
[2020/02/26 12:45:05.856] 2020-02-26 20:44:54,930 [DEBUG] mongo_orchestration.server:131 - Starting HTTP server on host: 127.0.0.1; port: 8889
[2020/02/26 12:45:05.856] 2020-02-26 20:44:59,506 [DEBUG] mongo_orchestration.apps:64 - base_uri((), {})
[2020/02/26 12:45:05.856] 2020-02-26 20:44:59,506 [DEBUG] mongo_orchestration.apps.servers:61 - base_uri()
[2020/02/26 12:45:05.856] 2020-02-26 20:44:59,506 [DEBUG] mongo_orchestration.apps:55 - send_result(200)
[2020/02/26 12:45:05.856] 2020-02-26 20:45:04,756 [DEBUG] mongo_orchestration.apps:64 - host_create((), {})
[2020/02/26 12:45:05.856] 2020-02-26 20:45:04,756 [DEBUG] mongo_orchestration.servers:166 - Server.__init__(C:/data/mci/4a8e5e162474e3a7efd75360b86dfa07/drivers-tools/mongodb/bin\mongod, {u'journal': True, u'logappend': True, u'bind_ip': u'127.0.0.1,::1', u'port': 27017, u'ipv6': True}, {}, secret, bob, pwd123)
[2020/02/26 12:45:05.856] 2020-02-26 20:45:04,756 [DEBUG] mongo_orchestration.servers:66 - Creating log file for C:/data/mci/4a8e5e162474e3a7efd75360b86dfa07/drivers-tools/mongodb/bin\mongod: c:\data\mci\4a8e5e162474e3a7efd75360b86dfa07\drivers-tools\.evergreen\orchestration\db\mongod-knmnrp\mongod.log
[2020/02/26 12:45:05.856] 2020-02-26 20:45:04,756 [DEBUG] mongo_orchestration.servers:227 - (u'C:/data/mci/4a8e5e162474e3a7efd75360b86dfa07/drivers-tools/mongodb/bin\\mongod', '--version')
[2020/02/26 12:45:05.856] 2020-02-26 20:45:04,772 [DEBUG] mongo_orchestration.process:218 - mprocess(name=u'C:/data/mci/4a8e5e162474e3a7efd75360b86dfa07/drivers-tools/mongodb/bin\\mongod', config_path='c:\\data\\mci\\4a8e5e162474e3a7efd75360b86dfa07\\drivers-tools\\.evergreen\\orchestration\\db\\mongo-mvycmn', port=27017, timeout=300)
[2020/02/26 12:45:05.856] 2020-02-26 20:45:04,772 [DEBUG] mongo_orchestration.process:230 - execute process: C:/data/mci/4a8e5e162474e3a7efd75360b86dfa07/drivers-tools/mongodb/bin\mongod --config c:\data\mci\4a8e5e162474e3a7efd75360b86dfa07\drivers-tools\.evergreen\orchestration\db\mongo-mvycmn --port 27017
[2020/02/26 12:45:05.856] 2020-02-26 20:45:04,772 [DEBUG] mongo_orchestration.process:166 - wait for 27017
[2020/02/26 12:45:05.856] 2020-02-26 20:45:05,822 [DEBUG] mongo_orchestration.process:171 - process is not alive
[2020/02/26 12:45:05.856] 2020-02-26 20:45:05,822 [ERROR] mongo_orchestration.servers:368 - Could not start Server. Please find server log below.
[2020/02/26 12:45:05.856] =====================================================
[2020/02/26 12:45:05.856] 2020-02-26 20:45:05,822 [ERROR] mongo_orchestration.servers:371 - 2020-02-26T20:45:04.803+0000 SEVERE: Failed global initialization: FileNotOpen Failed to open "c:\data\mci\4a8e5e162474e3a7efd75360b86dfa07\drivers-tools\.evergreen\orchestration\db\mongod-knmnrp\mongod.log"
[2020/02/26 12:45:05.856] 2020-02-26 20:45:05,822 [ERROR] mongo_orchestration.apps:68 - <function host_create at 0x0000000002049F98>
[2020/02/26 12:45:05.856] Traceback (most recent call last):
[2020/02/26 12:45:05.856] File "c:\data\mci\4a8e5e162474e3a7efd75360b86dfa07\drivers-tools\.evergreen\orchestration\venv\lib\site-packages\mongo_orchestration\apps\__init__.py", line 66, in wrap
[2020/02/26 12:45:05.856] return f(*arg, **kwd)
[2020/02/26 12:45:05.856] File "c:\data\mci\4a8e5e162474e3a7efd75360b86dfa07\drivers-tools\.evergreen\orchestration\venv\lib\site-packages\mongo_orchestration\apps\servers.py", line 83, in host_create
[2020/02/26 12:45:05.856] result = _host_create(data)
[2020/02/26 12:45:05.856] File "c:\data\mci\4a8e5e162474e3a7efd75360b86dfa07\drivers-tools\.evergreen\orchestration\venv\lib\site-packages\mongo_orchestration\apps\servers.py", line 52, in _host_create
[2020/02/26 12:45:05.856] params.get('version', ''))
[2020/02/26 12:45:05.856] File "c:\data\mci\4a8e5e162474e3a7efd75360b86dfa07\drivers-tools\.evergreen\orchestration\venv\lib\site-packages\mongo_orchestration\servers.py", line 518, in create
[2020/02/26 12:45:05.856] server.start(timeout)
[2020/02/26 12:45:05.856] File "c:\data\mci\4a8e5e162474e3a7efd75360b86dfa07\drivers-tools\.evergreen\orchestration\venv\lib\site-packages\mongo_orchestration\servers.py", line 380, in start
[2020/02/26 12:45:05.856] LOG_FILE + ' for more details.')
[2020/02/26 12:45:05.856] File "<string>", line 2, in reraise
[2020/02/26 12:45:05.856] TimeoutError: Could not start Server. Please check server log located in c:\data\mci\4a8e5e162474e3a7efd75360b86dfa07\drivers-tools\.evergreen\orchestration\db\mongod-knmnrp\mongod.log or the mongo-orchestration log in C:/data/mci/4a8e5e162474e3a7efd75360b86dfa07/drivers-tools/.evergreen/orchestration\server.log for more details.
[2020/02/26 12:45:05.856] 2020-02-26 20:45:05,822 [DEBUG] mongo_orchestration.apps:55 - send_result(500)
[2020/02/26 12:45:05.872] + exit 1
The important line is 2020-02-26T20:45:04.803+0000 SEVERE: Failed global initialization: FileNotOpen Failed to open "c:\data\mci\4a8e5e162474e3a7efd75360b86dfa07\drivers-tools\.evergreen\orchestration\db\mongod-knmnrp\mongod.log"
.
The nice thing about this change is that we now capture server start-up errors. For example, errors like
[main] Failed global initialization: BadValue: Unknown --setParameter 'failpoint.disableStapling'
will now be shown in the logs:Two changes:
CC: @vincentkam