search

bilelmsekni / OpenStack-Folsom-Install-guide

A full installation guide for OpenStack Folsom with Quantum
161 stars 136 forks source link

Instance IP allocation/ Meta data errors/ traffic troubles #101

Closed resoatti closed 11 years ago

resoatti commented 11 years ago

I am deploying a Three nic, Three node, vlan + quantum setup, and am unable to get an instance to contact the metadata server upon boot, nor reconfigured and successfully routeing via the horizon vnc interface. Any help will be greatly appreciated.

I am using the cirros uec guest.

I have included the nova.conf which should be mostly the same as the guide with the exception of an attempt to disable the firewall driver.

Control Node: eth0 (192.168.3.135), eth1 (192.168.4.135) Network Node: eth0 (192.168.3.200), eth1 (192.168.2.200), eth2 (192.168.4.200) Compute Node: eth0 (192.168.3.150), eth1 (192.168.2.150)

oscon1 - controller node

oscon1:~# ovs-vsctl show b59f5f0f-640a-408f-b5ea-de37a50c05e8 ovs_version: "1.4.3"

oscon1:~# ifconfig eth0 Link encap:Ethernet HWaddr 00:30:48:33:43:26 inet addr:192.168.3.135 Bcast:192.168.3.255 Mask:255.255.255.0 inet6 addr: fe80::230:48ff:fe33:4326/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:3888711 errors:0 dropped:0 overruns:0 frame:0 TX packets:4443466 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:1241576098 (1.2 GB) TX bytes:3426898167 (3.4 GB) Interrupt:18 Memory:d8200000-d8220000

eth1 Link encap:Ethernet HWaddr 00:30:48:33:43:27 inet addr:192.168.4.135 Bcast:192.168.4.255 Mask:255.255.255.0 inet6 addr: fe80::230:48ff:fe33:4327/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:1544823 errors:0 dropped:0 overruns:0 frame:0 TX packets:856152 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:1080250360 (1.0 GB) TX bytes:200394499 (200.3 MB) Interrupt:19 Memory:d8220000-d8240000

lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP LOOPBACK RUNNING MTU:16436 Metric:1 RX packets:37676468 errors:0 dropped:0 overruns:0 frame:0 TX packets:37676468 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:12024894256 (12.0 GB) TX bytes:12024894256 (12.0 GB)

oscon1:~# iptables -L Chain INPUT (policy ACCEPT) target prot opt source destination nova-api-INPUT all -- anywhere anywhere

Chain FORWARD (policy ACCEPT) target prot opt source destination nova-filter-top all -- anywhere anywhere nova-api-FORWARD all -- anywhere anywhere

Chain OUTPUT (policy ACCEPT) target prot opt source destination nova-filter-top all -- anywhere anywhere nova-api-OUTPUT all -- anywhere anywhere

Chain nova-api-FORWARD (1 references) target prot opt source destination

Chain nova-api-INPUT (1 references) target prot opt source destination ACCEPT tcp -- anywhere myextip.135 tcp dpt:8775

Chain nova-api-OUTPUT (1 references) target prot opt source destination

Chain nova-api-local (1 references) target prot opt source destination

Chain nova-filter-top (2 references) target prot opt source destination nova-api-local all -- anywhere anywhere

oscon1:~# route -n Kernel IP routing table Destination Gateway Genmask Flags Metric Ref Use Iface 0.0.0.0 192.168.4.1 0.0.0.0 UG 0 0 0 eth1 192.168.2.0 192.168.4.200 255.255.255.0 UG 0 0 0 eth1 192.168.3.0 0.0.0.0 255.255.255.0 U 0 0 0 eth0 192.168.4.0 0.0.0.0 255.255.255.0 U 0 0 0 eth1

nova.conf

[DEFAULT] logdir=/var/log/nova state_path=/var/lib/nova lock_path=/run/lock/nova verbose=True api_paste_config=/etc/nova/api-paste.ini scheduler_driver=nova.scheduler.simple.SimpleScheduler s3_host=192.168.3.135 ec2_host=192.168.3.135 ec2_dmz_host=192.168.3.135 rabbit_host=192.168.3.135 dmz_cidr=169.254.169.254/32 metadata_host=myextip.135 #Ive tried the 192.168.3 and .4 metadata_listen=0.0.0.0 sql_connection=mysql://novaUser:novaPass@192.168.3.135/nova root_helper=sudo nova-rootwrap /etc/nova/rootwrap.conf

Auth

auth_strategy=keystone keystone_ec2_url=http://192.168.3.135:5000/v2.0/ec2tokens

Imaging service

glance_api_servers=192.168.3.135:9292 image_service=nova.image.glance.GlanceImageService

Vnc configuration

vnc_enabled=true novncproxy_base_url=http://myextip.135:6080/vnc_auto.html novncproxy_port=6080 vncserver_proxyclient_address=192.168.3.150 vncserver_listen=0.0.0.0

Network settings

network_api_class=nova.network.quantumv2.api.API quantum_url=http://192.168.3.135:9696 quantum_auth_strategy=keystone quantum_admin_tenant_name=service quantum_admin_username=quantum quantum_admin_password=service_pass quantum_admin_auth_url=http://192.168.3.135/v2.0 libvirt_vif_driver=nova.virt.libvirt.vif.LibvirtHybridOVSBridgeDriver linuxnet_interface_driver=nova.network.linux_net.LinuxOVSInterfaceDriver firewall_driver=nova.virt.firewall.NoopFirewallDriver

Compute

compute_driver=libvirt.LibvirtDriver

Cinder

volume_api_class=nova.volume.cinder.API osapi_volume_listen_port=5900

osnet1 - network node

@osnet1:~# iptables -t nat -L Chain PREROUTING (policy ACCEPT) target prot opt source destination

Chain INPUT (policy ACCEPT) target prot opt source destination

Chain OUTPUT (policy ACCEPT) target prot opt source destination DNAT tcp -- anywhere 169.254.169.254 tcp dpt:http to:192.168.2.200:8775

Chain POSTROUTING (policy ACCEPT) target prot opt source destination

osnet1:~# ovs-vsctl show 29322ec0-14e0-4b62-8675-9253a3013f27 Bridge br-int Port br-int Interface br-int type: internal Bridge br-ex Port br-ex Interface br-ex type: internal Port "eth2" Interface "eth2" Bridge "br-eth1" Port "eth1" Interface "eth1" Port "br-eth1" Interface "br-eth1" type: internal ovs_version: "1.4.3"

osnet1:~# ifconfig br-ex Link encap:Ethernet HWaddr 00:30:48:34:2c:d9 inet addr:192.168.4.200 Bcast:192.168.4.255 Mask:255.255.255.0 inet6 addr: fe80::230:48ff:fe34:2cd9/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:1035249 errors:0 dropped:129953 overruns:0 frame:0 TX packets:334331 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:130775302 (130.7 MB) TX bytes:62205605 (62.2 MB)

eth0 Link encap:Ethernet HWaddr 00:02:b3:2f:c6:95 inet addr:192.168.3.200 Bcast:192.168.3.255 Mask:255.255.255.0 inet6 addr: fe80::202:b3ff:fe2f:c695/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:1545 errors:0 dropped:15 overruns:0 frame:0 TX packets:3339 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:458312 (458.3 KB) TX bytes:140670 (140.6 KB)

eth1 Link encap:Ethernet HWaddr 00:30:48:34:2c:d8 inet addr:192.168.2.200 Bcast:192.168.2.255 Mask:255.255.255.0 inet6 addr: fe80::230:48ff:fe34:2cd8/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:1417501 errors:0 dropped:0 overruns:0 frame:0 TX packets:1655 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:104878700 (104.8 MB) TX bytes:106554 (106.5 KB) Interrupt:18 Memory:d8200000-d8220000

eth2 Link encap:Ethernet HWaddr 00:30:48:34:2c:d9 inet6 addr: fe80::230:48ff:fe34:2cd9/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:1979559 errors:0 dropped:0 overruns:0 frame:0 TX packets:335471 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:195570951 (195.5 MB) TX bytes:63727457 (63.7 MB) Interrupt:19 Memory:d8220000-d8240000

lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP LOOPBACK RUNNING MTU:16436 Metric:1 RX packets:4060 errors:0 dropped:0 overruns:0 frame:0 TX packets:4060 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:433744 (433.7 KB) TX bytes:433744 (433.7 KB)

osnet1:~# route -n Kernel IP routing table Destination Gateway Genmask Flags Metric Ref Use Iface 0.0.0.0 192.168.4.1 0.0.0.0 UG 0 0 0 br-ex 192.168.2.0 0.0.0.0 255.255.255.0 U 0 0 0 eth1 192.168.3.0 0.0.0.0 255.255.255.0 U 0 0 0 eth0 192.168.4.0 0.0.0.0 255.255.255.0 U 0 0 0 br-ex

These were done during a ping from my controller node to an instance IP.

osnet1:~# tcpdump -i eth1 tcpdump: verbose output suppressed, use -v or -vv for full protocol decode listening on eth1, link-type EN10MB (Ethernet), capture size 65535 bytes 14:30:08.395580 STP 802.1d, Config, Flags [none], bridge-id 800a.00:17:95:33:a1:00.8013, length 43 14:30:08.525275 ARP, Request who-has 192.168.2.2 tell 192.168.2.200, length 28

osnet1:~# tcpdump -i br-ex |grep -v ssh tcpdump: verbose output suppressed, use -v or -vv for full protocol decode listening on br-ex, link-type EN10MB (Ethernet), capture size 65535 bytes 14:31:17.911702 IP 192.168.4.135 > 192.168.2.2: ICMP echo request, id 31781, seq 1911, length 64 14:31:18.893272 IP osnet1 > 192.168.4.135: ICMP host 192.168.2.2 unreachable, length 92

oscom1 - compute node

nova.conf

[DEFAULT] logdir=/var/log/nova state_path=/var/lib/nova lock_path=/run/lock/nova verbose=True api_paste_config=/etc/nova/api-paste.ini scheduler_driver=nova.scheduler.simple.SimpleScheduler s3_host=192.168.3.135 ec2_host=192.168.3.135 ec2_dmz_host=192.168.3.135 rabbit_host=192.168.3.135 dmz_cidr=169.254.169.254/32 metadata_host=myextip.135 #Ive tried the 192.168.3 and .4 metadata_listen=0.0.0.0 sql_connection=mysql://novaUser:novaPass@192.168.3.135/nova root_helper=sudo nova-rootwrap /etc/nova/rootwrap.conf

Auth

use_deprecated_auth=false auth_strategy=keystone keystone_ec2_url=http://192.168.3.135:5000/v2.0/ec2tokens

Imaging service

glance_api_servers=192.168.3.135:9292 image_service=nova.image.glance.GlanceImageService

Vnc configuration

novnc_enabled=true novncproxy_base_url=http://myextip.135:6080/vnc_auto.html novncproxy_port=6080 vncserver_proxyclient_address=192.168.3.150 vncserver_listen=0.0.0.0

Network settings

network_api_class=nova.network.quantumv2.api.API quantum_url=http://192.168.3.135:9696 quantum_auth_strategy=keystone quantum_admin_tenant_name=service quantum_admin_username=quantum quantum_admin_password=service_pass quantum_admin_auth_url=http://192.168.3.135:35357/v2.0 libvirt_vif_driver=nova.virt.libvirt.vif.LibvirtHybridOVSBridgeDriver linuxnet_interface_driver=nova.network.linux_net.LinuxOVSInterfaceDriver firewall_driver=nova.virt.firewall.NoopFirewallDriver

Compute

compute_driver=libvirt.LibvirtDriver

Cinder

volume_api_class=nova.volume.cinder.API osapi_volume_listen_port=5900

bilelmsekni commented 11 years ago

Solution here: https://github.com/mseknibilel/OpenStack-Folsom-Install-guide/issues/14#issuecomment-14127346

Support for the folsom guide will be ceased by the end of this month. I am currently working on the grizzly guide https://github.com/mseknibilel/OpenStack-Grizzly-Install-Guide