rcbops / opencenter

http://www.rackspace.com/cloud/private/openstack_software/
Other
9 stars 12 forks source link

[DE71] Chef server would not deploy #480

Closed retreved closed 11 years ago

retreved commented 11 years ago

We tried multiple times with fresh install to deploy chef-server on bare metal from opencenter and it kept rolling back. Logs below.

Added the following to /etc/environment: export OPENCENTER_ENDPOINT="https://username:password@localhost:8443" Logged out and back in. The statement is working. Executed the following to install chef on my chef server: opencentercli adventure execute 5 (chef server) 2 (install chef)

~# opencentercli task list id completed expires submitted parent state node action
1 1364395429 1364396081 1364395271 None done imhotep.example.com adventurate
2 1364395386 1364395301 1364395271 1 done Ramses.example.com install_chef_server
3 1364395407 1364395418 1364395388 1 done Ramses.example.com download_cookbooks
4 1364395425 1364395438 1364395408 1 done Ramses.example.com rollback_install_chef_server
~# opencentercli fact list
id
value node key
1 1 unprovisioned parent_id
2 1 support parent_id
3 [u'container', u'node'] workspace backends
4 [u'container', u'node'] unprovisioned backends
5 [u'container', u'node'] support backends
6 [u'node', u'agent'] Kawab.example.com backends
7 2 Kawab.example.com parent_id
8 [u'node', u'agent'] Ramses.example.com backends
9 2 Ramses.example.com parent_id
10 [u'node', u'agent'] Nefermaat.example.com backends
11 2 Nefermaat.example.com parent_id
12 [u'node', u'agent'] Hemiunu.example.com backends
13 2 Hemiunu.example.com parent_id
14 [u'node', u'agent'] imhotep.example.com backends
15 2 imhotep.example.com parent_id
16 None Ramses.example.com chef_server_client_name
17 None Ramses.example.com chef_server_client_pem
18 None Ramses.example.com chef_server_uri
19 None Ramses.example.com chef_server_pem
20 None Ramses.example.com chef_server_cookbook_channels

Task: {'completed': None, 'expires': 1364396081, 'submitted': 1364395271, 'payload': {u'nodes': [u'5'], u'globals': {}, u'adventure_dsl': [{u'primitive': u'install_chef_server', u'ns': {}, u'timeout': 600}, {u'primitive': u'node.add_backend', u'ns': {u'backend': u'chef-server'}, u'timeout': 30}, {u'primitive': u'node.set_parent', u'ns': {u'parent': 3}, u'timeout': 30}, {u'primitive': u'node.set_attr', u'ns': {u'value': True, u'key': u'locked'}, u'timeout': 30}, {u'primitive': u'download_cookbooks', u'ns': {u'CHEF_SERVER_COOKBOOK_CHANNELS': u'current'}, u'timeout': 120}]}, 'parent_id': None, 'state': u'running', 'node_id': 8, 'result': {}, 'action': u'adventurate', 'id': 1} notifying event task-for-5 notifying task-for-5 Task: {'completed': None, 'expires': 1364395301, 'submitted': 1364395271, 'payload': {u'globals': {u'parent_task_id': 1}, u'timeout': 600}, 'parent_id': 1, 'state': u'running', 'node_id': 5, 'result': {}, 'action': u'install_chef_server', 'id': 2} notifying event task-for-5 notifying task-for-5 no waiters on nodes-id-5... skipping waiting on task-for-5 waiting on task-for-5 waiting on task-for-5 waiting on task-for-5 waiting on task-for-5 waiting on task-for-5 waiting on task-for-5 waiting on task-for-5 waiting on task-for-5 waiting on task-for-5 Task: {'completed': 1364395386, 'expires': 1364395301, 'submitted': 1364395271, 'payload': {u'globals': {u'parent_task_id': 1}, u'timeout': 600}, 'parent_id': 1, 'state': u'done', 'node_id': 5, 'result': {u'response': {}, u'result_data': {u'consequences': [u"facts.chef_server_client_name := 'admin'", u"facts.chef_server_client_pem := '-----BEGIN RSA PRIVATE KEY-----\nMIIEpQIBAAKCAQEAwXiEC3SMVG6Ug164UoaT2cAHnqT8k0uJBwFYWt9a4A6UeQgj\nZHW41QjPTeCcM77qIp2upeG68PSrZ6BHT1k2+AxSuFfNvHGBEAEx9IrxUgSVvMo1\nu7YBxmcDErqkIFrtmcD37f34IlRbbBUJjmC5UZyfkMCvF62sMkkNnyo97w9lLooy\nNT8BrpLQ+GPpHbTG/8xpsvc0vK38w9offwrCme9PP1YxCxjkjtNp/mwcl38Z3CIT\nhcw+NNhE7eF9mKC8IOIkG7/jHUvOBG/YoaALHw5fcQ9Vxf5g7PVrLcydJRBpUdUp\npCwHz2xUQLDJFY8rJe0ojz1i/8mX0IqE7qZXbQIDAQABAoIBAQCxJI2Sh4YtkIo+\ntq2CMmKRj7fqVBpHK3Qti9fAbJ2iZPcg0ojFZNx1gnl9Ttj2sClkxIeyrroiAYQn\nf6OLTZ59A5uB2jMwBaUsaEu7IrTOahBIKcWFN6LsbEluDqJUVa0TiJH5wP4/QIns\nrl5vlLRZu1SGj0ZCIex2pljokR7gENpBdbjPs0oAR4U2aP5nDApmBYYWAzUmS6rC\nt9gnwLasNjuLZIiqO1HvXdXP7bedkrRgmFEVC4LECt7l+A3+uBtbA6ytOZYeHPZb\nTwRnqtUJJRumbvsNMExuORY/wE1HdIOF5FVxHUp554lE6JazDAtZISKCbNTqNBIg\nw4vLJRTBAoGBAOyIr57Nps8hsLda/nMkxYhi/O/sqOixYFZrJAkfzqHV0MVfi6kh\nHxDjJ2kSGtP/e3fX1d80K+vCP/683n1a6SDzUAEGJLkW9ilwye7MKmiLvTv64+nm\nfzbcVGJvugPO2m+DGBMBdIA0EeaqIY4Nk0d1heARJA3y6EFvqv6QlFuJAoGBANFk\nkmgsTUiXcJ7IEy28euO3PGJAp/W9gCy0soaPDBRsltj6+9tgG67Zmmvyb/OE/ELS\nqUlc2AxqOdu4Np0zh2xFKtO8rfJre4Q8zHSyb9sGxPJMpdsrg++DSmKCVZvSHKOC\nInc1ZUlxUEuGSeW3asadKSAnI4OoqXt9uzveD+/FAoGBAMfoee1QSCQViEJfIGB2\nepBbgQTR0qvfhdlj8e/YNw5mJG075FCMErJ2GU/fIld8PIC8JSDg+iHmaanFPJFb\nrV7Q5RQIei8IbgH2NmShn1H+kG/KCqgby/a03ojXfrJLOCg49rbRawITf/GgZn2l\nkY06kWwfcIZtfsgXNcCytwBpAoGBALDZ+K3zfPKqtXvmEAy4/DIIOP/jC/kJrJAV\nrhLoDpPRgzaQBNgsPDVZpIs3oEZVM5pcwo4r1G3n6iYhWD89nktbv+hFm8T78r6l\neym067RZ602aXxrVjgFlKhY5boTE2VtgNivo9TsqcV7YdOGIIK7PXkTBycURVtPu\nRY0y6NLhAoGAT0v08M7pASW310yhwmrfwGgcfNpnSvAVUnJ1QyIwVeq8gNXqwiG0\nmysIUbLVNsjpuRImoFCDJucBQgwEwB8WXoSTeUiVrIauNKIOh/vU7D1U3GKC3KeZ\n9+ASBv/hkmq4cpDcpPNY/WGeUf0UOyuK0T9hghlxWT38MNisCFioLQ8=\n-----END RSA PRIVATE KEY-----'", u"facts.chef_server_uri := 'https://10.5.2.40:443'", u"facts.chef_server_pem := '-----BEGIN RSA PRIVATE KEY-----\nMIIEogIBAAKCAQEA1Q8sJgJ/JDLpAIyyXUWU5zNRqIhKPL7gOeKUMSOCfR6t7SPx\nbQ+7xULZfsjUtdOA8E1Q43seGioNLWLNoo2tmvSpKswr/gxiK6oftXSBqh6Qu1iM\n+Vr8AUbRuY3AsXbXs66kp7O8FoKH6cyn9jLKUXjXFDw6zistVQJKt0BCbVrwZkYt\nVqPq7dtfmve3AKT2PfPcWIg52jorSs8FUhQYqJy67nm9NYjsg1jMaPAeP+hhJBpJ\n573MUL2NBJJMhrnMrXTrHLvdKBQKEs8jvrvcc5KizXUtPu6r4YYX1HQQPg1Dd0a6\nHjo+jX3M9EZ9AG6xCFLEfwV8v2jDtPhCXl3auwIDAQABAoIBAEP3BRRS84/ulZlR\nSIysZ6WhH0ltwJDEKu8MMk3CkButr7nYH2m0/Scd/heNpR0jjRwa7dTDL4UVKQLz\nY7mZDGpD5br7SoVOGfrn2BmgQsSr32uEAeSBe6ZEmx5f87oouQJekbPViAh+NzED\n0gidhyCaNbIEzJV7/IgDpSXz37zWEn+Q2ehs7sQ9GMmADd9epEgJOdeSUKTIOOzT\n/mkqO5al7Tukz2OlV3V1csYM9E2MOuXdtIkvrYLDNs/gJmoMtHA4nijZHqRvPBZY\nm+r9zIzKtoS4jsQPt3vafXxu3i0IP1KoFi2V4MC7Mi009h1TU4CZ9hS+FI5qbiBQ\nJ8jpDaECgYEA8vs57lvFdmYosx+DZ25iUyjRa4vvgiEqN+ciivZ5voc/6fKNSkvF\nzPiwr7GEJiyb0YT6CPYtwYLGJy4d/y+CMu2JTUk3hGI4Hj2ssn65AS2YaMQaYzJS\nLzKwuhGBdD54eoKQow2hvMIHbnC8NzjG7mAfKvRgv8IgHMtvz/QPekkCgYEA4HmH\nnIr2EvH9HNAucmdrhB5ARYoBN2D7zG+8gQ3WZMwkK8zmtJdd8Gl1+iRVraRyvIL6\nm1PQ9UvjWGEI4gVCDVV4rXUwJ4cdn4Akyk18BFx+SdC+ZhI2tbPH548F+VVLA9g8\naSMDD7XQNskBhoeLu6dTk3vZZs0Mvc1EdbuhDOMCgYBa09JZ6XAszA9Wteb22Opk\nT5PI8ew75o3Ti9D7xRrJP+GCYCq0pRJxhlz1sBPH+VDdxyl4BB4igfH0X2bTJz0y\nMFzsyPu5vsVfeIp/xqL9b7/TGcsLXZofDoHFbBnKDDgZA4lxifz1hEom3Hle4xhp\nrwC3m9Y2mChM2zcWsxK+EQKBgHh9g2dpx9A/iGew712FWdbfDgzFmQWKz13bFEoJ\njW0pjrjcEXIaVdg4I5WTb1H3lYbOn4pEoUMp6uyDmWsI+32AxXgGEUUGZ8Y32Iem\ns8z7gOZKYAkV+bvqtoD66m/9cnir1zFwE7KZGxxtJJ57n2uo01m0/usJYa93wSmY\n/0eVAoGAXExh5cB4FwFQoYm9csRdMLqEH62e8R5Ve9K44Shg1qRLdzL8AJzFwXYU\n1wpbzS9CDsMu1JM8pWgFMgZZdn2JZ8uky/uQC82LvtXgCQ/9Fupiz5F3u0i9bVmV\nx3MUWqNAer3+qqQ2QblrZvjsU+ag/3Y8rWLV5sQlJv58gT6+qho=\n-----END RSA PRIVATE KEY-----'", u"facts.chef_server_cookbook_channels := 'current'"], u'script': u'/usr/share/opencenter-agent/plugins/lib/bash/chef/install-chef-server.sh'}, u'result_code': 0, u'result_str': u'Success'}, 'action': u'install_chef_server', 'id': 2} notifying event task-for-5 notifying task-for-5 waiting on task-for-5 waiting on task-for-5 no waiters on nodes-id-5... skipping notifying event task-for-5 notifying task-for-5 Task: {'completed': None, 'expires': 1364395418, 'submitted': 1364395388, 'payload': {u'CHEF_SERVER_COOKBOOK_CHANNELS': u'current', u'globals': {u'parent_task_id': 1}, u'timeout': 120}, 'parent_id': 1, 'state': u'running', 'node_id': 5, 'result': {}, 'action': u'download_cookbooks', 'id': 3} notifying event task-for-5 notifying task-for-5 no waiters on nodes-id-5... skipping waiting on task-for-5 waiting on task-for-5 waiting on task-for-5 waiting on task-for-5 Task: {'completed': 1364395407, 'expires': 1364395418, 'submitted': 1364395388, 'payload': {u'CHEF_SERVER_COOKBOOK_CHANNELS': u'current', u'globals': {u'parent_task_id': 1}, u'timeout': 120}, 'parent_id': 1, 'state': u'done', 'node_id': 5, 'result': {u'response': {}, u'result_data': {u'consequences': [], u'script': u'/usr/share/opencenter-agent/plugins/lib/bash/chef/cookbook-download.sh'}, u'result_code': 1, u'result_str': u'Failure'}, 'action': u'download_cookbooks', 'id': 3} notifying event task-for-5 notifying task-for-5 waiting on task-for-5 waiting on task-for-5 no waiters on nodes-id-5... skipping notifying event task-for-5 notifying task-for-5 Task: {'completed': None, 'expires': 1364395438, 'submitted': 1364395408, 'payload': {u'globals': {u'parent_task_id': 1}, u'timeout': 30}, 'parent_id': 1, 'state': u'running', 'node_id': 5, 'result': {}, 'action': u'rollback_install_chef_server', 'id': 4} notifying event task-for-5 notifying task-for-5 no waiters on nodes-id-5... skipping waiting on task-for-5 waiting on task-for-5 waiting on task-for-5 waiting on task-for-5 Task: {'completed': 1364395425, 'expires': 1364395438, 'submitted': 1364395408, 'payload': {u'globals': {u'parent_task_id': 1}, u'timeout': 30}, 'parent_id': 1, 'state': u'done', 'node_id': 5, 'result': {u'response': {}, u'result_data': {u'consequences': [u"facts.backends := remove(facts.backends, 'chef-server')", u'facts.chef_server_client_name := none', u'facts.chef_server_client_pem := none', u'facts.chef_server_uri := none', u'facts.chef_server_pem := none', u'facts.chef_server_cookbook_channels := none'], u'script': u'/usr/share/opencenter-agent/plugins/lib/bash/chef/uninstall-chef-server.sh'}, u'result_code': 0, u'result_str': u'Success'}, 'action': u'rollback_install_chef_server', 'id': 4} notifying event task-for-5 notifying task-for-5 waiting on task-for-5 waiting on task-for-5 no waiters on nodes-id-5... skipping Task: {'completed': 1364395429, 'expires': 1364396081, 'submitted': 1364395271, 'payload': {u'nodes': [u'5'], u'globals': {}, u'adventure_dsl': [{u'primitive': u'install_chef_server', u'ns': {}, u'timeout': 600}, {u'primitive': u'node.add_backend', u'ns': {u'backend': u'chef-server'}, u'timeout': 30}, {u'primitive': u'node.set_parent', u'ns': {u'parent': 3}, u'timeout': 30}, {u'primitive': u'node.set_attr', u'ns': {u'value': True, u'key': u'locked'}, u'timeout': 30}, {u'primitive': u'download_cookbooks', u'ns': {u'CHEF_SERVER_COOKBOOK_CHANNELS': u'current'}, u'timeout': 120}]}, 'parent_id': None, 'state': u'done', 'node_id': 8, 'result': {u'result_str': u'adventure failed', u'result_code': 1, u'result_data': {u'rollbacks': {u'5': [{u'primitive': u'node.del_attr', u'ns': {u'globals': {u'parent_task_id': 1}, u'key': u'locked'}}, {u'primitive': u'node.set_parent', u'ns': {u'globals': {u'parent_task_id': 1}, u'parent': 2}}, {u'primitive': u'node.set_fact', u'ns': {u'globals': {u'parent_task_id': 1}, u'key': u'backends', u'value': [u'node', u'agent']}}, {u'primitive': u'rollback_install_chef_server', u'ns': {u'globals': {u'parent_task_id': 1}, u'timeout': 30}}]}, u'history': [{u'result_str': u'ran primitive agent.run_task: 0/1 completed successfully', u'result_code': 1, u'result_data': {u'5': {u'result_str': u'Task failed', u'result_code': 1, u'result_data': {}}}}, {u'result_str': u'ran primitive node.set_attr: 1/1 completed successfully', u'result_code': 0, u'result_data': {u'5': {u'result_str': u'Action succeeded', u'result_code': 0, u'result_data': {u'rollback': {u'primitive': u'node.del_attr', u'ns': {u'globals': {u'parent_task_id': 1}, u'key': u'locked'}}}}}}, {u'result_str': u'ran primitive node.set_parent: 1/1 completed successfully', u'result_code': 0, u'result_data': {u'5': {u'result_str': u'Action succeeded', u'result_code': 0, u'result_data': {u'rollback': {u'primitive': u'node.set_parent', u'ns': {u'globals': {u'parent_task_id': 1}, u'parent': 2}}}}}}, {u'result_str': u'ran primitive node.add_backend: 1/1 completed successfully', u'result_code': 0, u'result_data': {u'5': {u'result_str': u'Action succeeded', u'result_code': 0, u'result_data': {u'rollback': {u'primitive': u'node.set_fact', u'ns': {u'globals': {u'parent_task_id': 1}, u'key': u'backends', u'value': [u'node', u'agent']}}}}}}, {u'result_str': u'ran primitive agent.run_task: 1/1 completed successfully', u'result_code': 0, u'result_data': {u'5': {u'result_str': u'Action succeeded', u'result_code': 0, u'result_data': {u'rollback': {u'primitive': u'rollback_install_chef_server', u'ns': {u'globals': {u'parent_task_id': 1}, u'timeout': 30}}}}}}]}}, 'action': u'adventurate', 'id': 1} waiting on task-for-5

ERROR: Errno::EHOSTUNREACH: No route to host - connect(2) /opt/chef-server/embedded/lib/ruby/1.9.1/net/http.rb:762:in initialize': No route to host - connect(2) (Errno::EHOSTUNREACH) from /opt/chef-server/embedded/lib/ruby/1.9.1/net/http.rb:762:inopen' from /opt/chef-server/embedded/lib/ruby/1.9.1/net/http.rb:762:in block in connect' from /opt/chef-server/embedded/lib/ruby/1.9.1/timeout.rb:68:intimeout' from /opt/chef-server/embedded/lib/ruby/1.9.1/timeout.rb:99:in timeout' from /opt/chef-server/embedded/lib/ruby/1.9.1/net/http.rb:762:inconnect' from /opt/chef-server/embedded/lib/ruby/1.9.1/net/http.rb:755:in do_start' from /opt/chef-server/embedded/lib/ruby/1.9.1/net/http.rb:744:instart' from /opt/chef-server/embedded/lib/ruby/gems/1.9.1/gems/rest-client-1.6.7/lib/restclient/request.rb:172:in transmit' from /opt/chef-server/embedded/lib/ruby/gems/1.9.1/gems/rest-client-1.6.7/lib/restclient/request.rb:64:inexecute' from /opt/chef-server/embedded/lib/ruby/gems/1.9.1/gems/rest-client-1.6.7/lib/restclient/request.rb:33:in execute' from /opt/chef-server/embedded/lib/ruby/gems/1.9.1/gems/rest-client-1.6.7/lib/restclient/resource.rb:76:input' from /opt/chef-server/embedded/lib/ruby/gems/1.9.1/gems/chef-11.0.0/lib/chef/cookbook_uploader.rb:142:in block in uploader_function_for' from /opt/chef-server/embedded/lib/ruby/gems/1.9.1/gems/chef-11.0.0/lib/chef/cookbook_uploader.rb:25:incall' from /opt/chef-server/embedded/lib/ruby/gems/1.9.1/gems/chef-11.0.0/lib/chef/cookbook_uploader.rb:25:in block (3 levels) in setup_worker_threads' from /opt/chef-server/embedded/lib/ruby/gems/1.9.1/gems/chef-11.0.0/lib/chef/cookbook_uploader.rb:24:inloop' from /opt/chef-server/embedded/lib/ruby/gems/1.9.1/gems/chef-11.0.0/lib/chef/cookbook_uploader.rb:24:in `block (2 levels) in setup_worker_threads'

galstrom21 commented 11 years ago

@retreved: what OS is this on?

retreved commented 11 years ago

Ubuntu 12.04, in customer DC. Standard installation, apt-get update was run before installing opencenter.

breu commented 11 years ago

@retreved can you supply a node list for the environment and a description around the tasks that each node will perform?

Can you paste the log from tasks 1 and 2 as well?

devx commented 11 years ago

I'm seeing the same problem, but I'm able to install the chef server. Unfortunately it rolls back because it fails to download the cookbooks. Additionally the transaction log for the download is blank so there is nothing there.

This is also on Ubuntu 12.04 / 64 Bit OS/

*( I omitted the private key to cutdown the length of the message )

Here are the task Task: {'completed': None, 'expires': 1365158212, 'submitted': 1365157402, 'payload': {u'nodes': [5], u'globals': {}, u'adventure_dsl': [{u'primitive': u'install_chef_server', u'ns': {}, u'timeout': 600}, {u'primitive': u'node.add_backend', u'ns': {u'backend': u'chef-server'}, u'timeout': 30}, {u'primitive': u'node.set_parent', u'ns': {u'parent': 3}, u'timeout': 30}, {u'primitive': u'node.set_attr', u'ns': {u'value': True, u'key': u'locked'}, u'timeout': 30}, {u'primitive': u'download_cookbooks', u'ns': {u'CHEF_SERVER_COOKBOOK_CHANNELS': u'current'}, u'timeout': 120}]}, 'parent_id': None, 'state': u'running', 'node_id': 4, 'result': {}, 'action': u'adventurate', 'id': 135} Task: {'completed': None, 'expires': 1365157433, 'submitted': 1365157403, 'payload': {u'globals': {u'parent_task_id': 135}, u'timeout': 600}, 'parent_id': 135, 'state': u'running', 'node_id': 5, 'result': {}, 'action': u'install_chef_server', 'id': 136}

Task: {'completed': 1365157567, 'expires': 1365157433, 'submitted': 1365157403, 'payload': {u'globals': {u'parent_task_id': 135}, u'timeout': 600}, 'parent_id': 135, 'state': u'done', 'node_id': 5, 'result': {u'response': {}, u'result_data': {u'consequences': [u"facts.chef_server_client_name := 'admin'", u"facts.chef_server_client_pem := '-----BEGIN RSA PRIVATE KEY----- ...... -----END RSA PRIVATE KEY-----'", u"facts.chef_server_uri := 'https://192.168.100.104:443'", u"facts.chef_server_pem := '-----BEGIN RSA PRIVATE KEY----- ... -----END RSA PRIVATE KEY-----'", u"facts.chef_server_cookbook_channels := 'current'"], u'script': u'/usr/share/opencenter-agent/plugins/lib/bash/chef/install-chef-server.sh'}, u'result_code': 0, u'result_str': u'Success'}, 'action': u'install_chef_server', 'id': 136} Task: {'completed': None, 'expires': 1365157601, 'submitted': 1365157571, 'payload': {u'CHEF_SERVER_COOKBOOK_CHANNELS': u'current', u'globals': {u'parent_task_id': 135}, u'timeout': 120}, 'parent_id': 135, 'state': u'running', 'node_id': 5, 'result': {}, 'action': u'download_cookbooks', 'id': 137} Task: {'completed': 1365157632, 'expires': 1365157601, 'submitted': 1365157571, 'payload': {u'CHEF_SERVER_COOKBOOK_CHANNELS': u'current', u'globals': {u'parent_task_id': 135}, u'timeout': 120}, 'parent_id': 135, 'state': u'done', 'node_id': 5, 'result': {u'result_str': u'Channel "current" not available', u'result_code': 100, u'result_data': {}}, 'action': u'download_cookbooks', 'id': 137} Task: {'completed': None, 'expires': 1365157663, 'submitted': 1365157633, 'payload': {u'globals': {u'parent_task_id': 135}, u'timeout': 30}, 'parent_id': 135, 'state': u'running', 'node_id': 5, 'result': {}, 'action': u'rollback_install_chef_server', 'id': 138}

Task: {'completed': 1365157657, 'expires': 1365157663, 'submitted': 1365157633, 'payload': {u'globals': {u'parent_task_id': 135}, u'timeout': 30}, 'parent_id': 135, 'state': u'done', 'node_id': 5, 'result': {u'response': {}, u'result_data': {u'consequences': [u"facts.backends := remove(facts.backends, 'chef-server')", u'facts.chef_server_client_name := none', u'facts.chef_server_client_pem := none', u'facts.chef_server_uri := none', u'facts.chef_server_pem := none', u'facts.chef_server_cookbook_channels := none'], u'script': u'/usr/share/opencenter-agent/plugins/lib/bash/chef/uninstall-chef-server.sh'}, u'result_code': 0, u'result_str': u'Success'}, 'action': u'rollback_install_chef_server', 'id': 138}

Task: {'completed': 1365157660, 'expires': 1365158212, 'submitted': 1365157402, 'payload': {u'nodes': [5], u'globals': {}, u'adventure_dsl': [{u'primitive': u'install_chef_server', u'ns': {}, u'timeout': 600}, {u'primitive': u'node.add_backend', u'ns': {u'backend': u'chef-server'}, u'timeout': 30}, {u'primitive': u'node.set_parent', u'ns': {u'parent': 3}, u'timeout': 30}, {u'primitive': u'node.set_attr', u'ns': {u'value': True, u'key': u'locked'}, u'timeout': 30}, {u'primitive': u'download_cookbooks', u'ns': {u'CHEF_SERVER_COOKBOOK_CHANNELS': u'current'}, u'timeout': 120}]}, 'parent_id': None, 'state': u'done', 'node_id': 4, 'result': {u'result_str': u'adventure failed', u'result_code': 1, u'result_data': {u'rollbacks': {u'5': [{u'primitive': u'node.del_attr', u'ns': {u'globals': {u'parent_task_id': 135}, u'key': u'locked'}}, {u'primitive': u'node.set_parent', u'ns': {u'globals': {u'parent_task_id': 135}, u'parent': 2}}, {u'primitive': u'node.set_fact', u'ns': {u'globals': {u'parent_task_id': 135}, u'key': u'backends', u'value': [u'node', u'agent']}}, {u'primitive': u'rollback_install_chef_server', u'ns': {u'globals': {u'parent_task_id': 135}, u'timeout': 30}}]}, u'history': [{u'result_str': u'ran primitive agent.run_task: 0/1 completed successfully', u'result_code': 1, u'result_data': {u'5': {u'result_str': u'Task failed', u'result_code': 1, u'result_data': {}}}}, {u'result_str': u'ran primitive node.set_attr: 1/1 completed successfully', u'result_code': 0, u'result_data': {u'5': {u'result_str': u'Action succeeded', u'result_code': 0, u'result_data': {u'rollback': {u'primitive': u'node.del_attr', u'ns': {u'globals': {u'parent_task_id': 135}, u'key': u'locked'}}}}}}, {u'result_str': u'ran primitive node.set_parent: 1/1 completed successfully', u'result_code': 0, u'result_data': {u'5': {u'result_str': u'Action succeeded', u'result_code': 0, u'result_data': {u'rollback': {u'primitive': u'node.set_parent', u'ns': {u'globals': {u'parent_task_id': 135}, u'parent': 2}}}}}}, {u'result_str': u'ran primitive node.add_backend: 1/1 completed successfully', u'result_code': 0, u'result_data': {u'5': {u'result_str': u'Action succeeded', u'result_code': 0, u'result_data': {u'rollback': {u'primitive': u'node.set_fact', u'ns': {u'globals': {u'parent_task_id': 135}, u'key': u'backends', u'value': [u'node', u'agent']}}}}}}, {u'result_str': u'ran primitive agent.run_task: 1/1 completed successfully', u'result_code': 0, u'result_data': {u'5': {u'result_str': u'Action succeeded', u'result_code': 0, u'result_data': {u'rollback': {u'primitive': u'rollback_install_chef_server', u'ns': {u'globals': {u'parent_task_id': 135}, u'timeout': 30}}}}}}]}}, 'action': u'adventurate', 'id': 135}

claco commented 11 years ago

@devx, @retreved Can you supply the actual task logs for these failures?

@retreved, from the trace, it appears that the cookbook download succeeded, but it failed to connect to the chef server during knife upload (chef server being facts.chef_server_uri := 'https://10.5.2.40:443'). Do you also happen to have the OpenCenter Server running on 10.5.2.40? I believe you can not run the OpenCenter Server and the Chef Server on the same machine due to service port collisions.

@devx, from your trace, it appears you're having a slightly different issue. "Channel "current" not available" seems to imply the upstream manifest couldn't be downloaded, let alone the cookbooks tarball. IIRC, you had another ticket for issue behind a proxy. Is the above stack trace on machines behind a proxy? If so, I assume it is indeed proxy related issues which should be fixed in the commits below.

@devx, @retreved

There are a few fixes in the sprint branches that address various proxy issues, as well as chef node_name, hostname -f, and hostname -s usage in the install scripts / knife/client.rb.

https://github.com/rcbops/opencenter/commit/826a6d67e81ea350acfd77ad133a67db88436f09 https://github.com/rcbops/opencenter-agent/commit/07672ac988bf83fac1f64a782ff41eb609b29760 https://github.com/rcbops/opencenter-agent/commit/0604dec445906f94212ae1e04ad357ccca56f75b

claco commented 11 years ago

Closing this ticket since no one replied.