termie / nova-migration-demo

Nova is a cloud computing fabric controller (the main part of an IaaS system). It is written in Python.
http://openstack.org/projects/compute/
Apache License 2.0
2 stars 0 forks source link

RunInstance failed due to network error in RHEL6 #768

Open termie opened 13 years ago

termie commented 13 years ago

I failed to start an instance in redhat6. I pasted the error log and related info as below.

nova-compute.log:

2011-03-18 11:30:11,127 nova.root: Starting compute node (version 2011.1.1-workspace:tarmac-20110224184504-4e19t5nx33b8gpy9) 2011-03-18 12:15:19,210 nova.compute.manager: AUDIT [VDZV50V03FK-MZD9G9JK anne IRT] instance 1: starting... 2011-03-18 12:25:21,328 nova.root: Exception during message handling (nova.root): TRACE: Traceback (most recent call last): (nova.root): TRACE: File "/usr/lib/python2.6/site-packages/nova/rpc.py", line 192, in receive (nova.root): TRACE: rval = node_func(context=ctxt, *_node_args) (nova.root): TRACE: File "/usr/lib/python2.6/site-packages/nova/exception.py", line 116, in _wrap (nova.root): TRACE: return f(_args, *kw) (nova.root): TRACE: File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 196, in run_instance (nova.root): TRACE: self.get_network_topic(context), (nova.root): TRACE: File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 151, in get_network_topic (nova.root): TRACE: host = self.network_manager.get_network_host(context) (nova.root): TRACE: File "/usr/lib/python2.6/site-packages/nova/network/manager.py", line 552, in get_network_host (nova.root): TRACE: "args": {"network_id": network_ref['id']}}) (nova.root): TRACE: File "/usr/lib/python2.6/site-packages/nova/rpc.py", line 341, in call (nova.root): TRACE: raise wait_msg.result (nova.root): TRACE: RemoteError: ProcessExecutionError Unexpected error while running command. (nova.root): TRACE: Command: sudo -E dnsmasq --strict-order --bind-interfaces --conf-file= --pid-file=/var/lib/nova/networks/nova-br100.pid --listen-address=10.0.0.1 --except-interface=lo --dhcp-range=10.0.0.3,static,120s --dhcp-hostsfile=/var/lib/nova/networks/nova-br100.conf --dhcp-script=/usr/bin/nova-dhcpbridge --leasefile-ro (nova.root): TRACE: Exit code: 3 (nova.root): TRACE: Stdout: '' (nova.root): TRACE: Stderr: '\ndnsmasq: cannot run lease-init script /usr/bin/nova-dhcpbridge: No such file or directory\n' (nova.root): TRACE: [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.6/site-packages/nova/rpc.py", line 192, in receive\n rval = node_func(context=ctxt, _node_args)\n', u' File "/usr/lib/python2.6/site-packages/nova/network/manager.py", line 143, in set_network_host\n self._on_set_network_host(context, network_id)\n', u' File "/usr/lib/python2.6/site-packages/nova/network/manager.py", line 577, in _on_set_network_host\n self.driver.update_dhcp(context, network_id)\n', u' File "/usr/lib/python2.6/site-packages/nova/network/linux_net.py", line 267, in update_dhcp\n _execute(command, addl_env=env)\n', u' File "/usr/lib/python2.6/site-packages/nova/network/linux_net.py", line 327, in _execute\n return utils.execute(cmd, args, _kwargs)\n', u' File "/usr/lib/python2.6/site-packages/nova/utils.py", line 147, in execute\n cmd=cmd)\n', u"ProcessExecutionError: Unexpected error while running command.\nCommand: sudo -E dnsmasq --strict-order --bind-interfaces --conf-file= --pid-file=/var/lib/nova/networks/nova-br100.pid --listen-address=10.0.0.1 --except-interface=lo --dhcp-range=10.0.0.3,static,120s --dhcp-hostsfile=/var/lib/nova/networks/nova-br100.conf --dhcp-script=/usr/bin/nova-dhcpbridge --leasefile-ro\nExit code: 3\nStdout: ''\nStderr: '\ndnsmasq: cannot run lease-init script /usr/bin/nova-dhcpbridge: No such file or directory\n'\n"](nova.root): TRACE:

The version of nova-compute is 2011.1.1.

And the contents of nova.conf is as below.

--verbose=false --ec2_url=http://127.0.0.1:8773/services/Cloud --s3_host=127.0.0.1 --cc_host=127.0.0.1 --rabbit_host=127.0.0.1 --sql_connection=mysql://root:nova@127.0.0.1/nova --glance_port=9292 --glance_host=127.0.0.1 --use_s3=true --libvirt_type=kvm --use_syslog=false --node_availability_zone= --logging_context_format_string=%(asctime)s %(name)s: %(levelname)s [%(request_id)s %(user)s %(project)s] %(message)s --logging_default_format_string=%(asctime)s %(name)s: %(message)s --logging_debug_format_suffix= --use_cow_images=true --auth_driver=nova.auth.dbdriver.DbDriver --network_manager=nova.network.manager.VlanManager --scheduler_driver=nova.scheduler.zone.ZoneScheduler --image_service=nova.image.s3.S3ImageService --use_ipv6=false --ca_path=/var/lib/nova/CA --keys_path=/var/lib/nova/keys --images_path=/var/lib/nova/images --buckets_path=/var/lib/nova/buckets --instances_path=/var/lib/nova/instances --networks_path=/var/lib/nova/networks --dhcpbridge_flagfile=/etc/nova/nova.conf --dhcpbridge=/usr/bin/nova-dhcpbridge --injected_network_template=/usr/share/nova/interfaces.rhel.template --libvirt_xml_template=/usr/share/nova/libvirt.xml.template --vpn_client_template=/usr/share/nova/client.ovpn.template --credentials_template=/usr/share/nova/novarc.template --state_path=/var/lib/nova --volume_group=vg_redhat6


Imported from Launchpad using lp2gh.

termie commented 13 years ago

(by abrindeyev) Please provide additional details:

I got this build working with RHEL 5.6 image on RHEL 6.0 host, here is my nova-compute.log:

2011-03-18 17:02:50,469 nova.root: Starting compute node (version 2011.1.1-workspace:tarmac-20110224184504-4e19t5nx33b8gpy9) 2011-03-18 17:07:19,712 nova.compute.manager: AUDIT [3TW7--O43HHE1C5JKEAN abr rhelimg] instance 1: starting... 2011-03-18 17:07:21,732 nova.root: called setup_basic_filtering in nwfilter 2011-03-18 17:07:21,732 nova.root: ensuring static filters 2011-03-18 17:07:21,856 nova.root: new_filter: # Generated by iptables-save v1.4.7 on Fri Mar 18 17:07:21 2011 *filter :INPUT ACCEPT [0:0] :FORWARD ACCEPT [0:0] :OUTPUT ACCEPT [80:65200] :nova-fallback - [0:0] :nova-local - [0:0] :nova-inst-1 - [0:0] :nova-sg-1 - [0:0] -A nova-fallback -j DROP -A FORWARD -j nova-local -A OUTPUT -j nova-local -A nova-local -d 192.168.99.3 -j nova-inst-1 -A nova-inst-1 -m state --state INVALID -j DROP -A nova-inst-1 -m state --state ESTABLISHED,RELATED -j ACCEPT -A nova-inst-1 -j nova-sg-1 -A nova-inst-1 -s 192.168.99.1 -p udp --sport 67 --dport 68 -j ACCEPT -A nova-inst-1 -s 192.168.99.0/25 -j ACCEPT -A nova-inst-1 -j nova-fallback -A INPUT -i virbr0 -p udp -m udp --dport 53 -j ACCEPT -A INPUT -i virbr0 -p tcp -m tcp --dport 53 -j ACCEPT -A INPUT -i virbr0 -p udp -m udp --dport 67 -j ACCEPT -A INPUT -i virbr0 -p tcp -m tcp --dport 67 -j ACCEPT -A INPUT -m state --state RELATED,ESTABLISHED -j ACCEPT -A INPUT -p icmp -j ACCEPT -A INPUT -i lo -j ACCEPT -A INPUT -p tcp -m state --state NEW -m tcp --dport 22 -j ACCEPT -A INPUT -j REJECT --reject-with icmp-host-prohibited -A FORWARD -o br100 -j ACCEPT -A FORWARD -i br100 -j ACCEPT -A FORWARD -d 192.168.99.2/32 -p udp -m udp --dport 1194 -j ACCEPT -A FORWARD -d 192.168.122.0/24 -o virbr0 -m state --state RELATED,ESTABLISHED -j ACCEPT -A FORWARD -s 192.168.122.0/24 -i virbr0 -j ACCEPT -A FORWARD -i virbr0 -o virbr0 -j ACCEPT -A FORWARD -o virbr0 -j REJECT --reject-with icmp-port-unreachable -A FORWARD -i virbr0 -j REJECT --reject-with icmp-port-unreachable -A FORWARD -m physdev --physdev-is-bridged -j ACCEPT -A FORWARD -j REJECT --reject-with icmp-host-prohibited COMMIT

Completed on Fri Mar 18 17:07:21 2011

2011-03-18 17:07:21,911 nova.virt.libvirt_conn: instance instance-00000001: Creating image 2011-03-18 17:07:22,657 nova.virt.libvirt_conn: instance instance-00000001: injecting key into image ami-kk6kb8bs