Open adnaniqbal opened 7 years ago
@adnaniqbal There were lots of changes happened in the neutron component in ocata release. Which causing issues in contrail plugin + neutron service to up. This could be the reason. I was trying to resolve this issue from past 30 days but no clue.
Using Ubuntu 14.04, Contrail release 4.0 with devstack stable/ocata First installed contrail following pretty much http://www.inetsix.net/2016/02/26/Contrail-Devstack.html After that installing devstack which fails when it comes to starting neutron service. It fails while executing start_neutron_service_and_check function in neutron-legacy. I am unable to figure out why this is happening?
Below are the final lines of ./stack.sh 2017-10-27 11:25:44.551 | +lib/neutron-legacy:start_neutron_service_and_check:475 cfg_file_options='--config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/opencontrail/ContrailPlugin.ini' 2017-10-27 11:25:44.556 | +lib/neutron-legacy:start_neutron_service_and_check:477 is_service_enabled tls-proxy 2017-10-27 11:25:44.581 | +functions-common:is_service_enabled:2073 return 1 2017-10-27 11:25:44.586 | +lib/neutron-legacy:start_neutron_service_and_check:482 run_process q-svc '/usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/opencontrail/ContrailPlugin.ini' 2017-10-27 11:25:44.591 | +functions-common:run_process:1474 local service=q-svc 2017-10-27 11:25:44.595 | +functions-common:run_process:1475 local 'command=/usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/opencontrail/ContrailPlugin.ini' 2017-10-27 11:25:44.599 | +functions-common:run_process:1476 local group= 2017-10-27 11:25:44.604 | +functions-common:run_process:1477 local subservice= 2017-10-27 11:25:44.608 | +functions-common:run_process:1479 local name=q-svc 2017-10-27 11:25:44.612 | +functions-common:run_process:1481 time_start run_process 2017-10-27 11:25:44.617 | +functions-common:time_start:2384 local name=run_process 2017-10-27 11:25:44.621 | +functions-common:time_start:2385 local start_time= 2017-10-27 11:25:44.625 | +functions-common:time_start:2386 [[ -n '' ]] 2017-10-27 11:25:44.631 | ++functions-common:time_start:2389 date +%s 2017-10-27 11:25:44.637 | +functions-common:time_start:2389 _TIME_START[$name]=1509103544 2017-10-27 11:25:44.641 | +functions-common:run_process:1482 is_service_enabled q-svc 2017-10-27 11:25:44.671 | +functions-common:is_service_enabled:2073 return 0 2017-10-27 11:25:44.676 | +functions-common:run_process:1483 [[ True = \T\r\u\e ]] 2017-10-27 11:25:44.680 | +functions-common:run_process:1484 screen_process q-svc '/usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/opencontrail/ContrailPlugin.ini' '' 2017-10-27 11:25:44.685 | +functions-common:screen_process:1500 local name=q-svc 2017-10-27 11:25:44.689 | +functions-common:screen_process:1501 local 'command=/usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/opencontrail/ContrailPlugin.ini' 2017-10-27 11:25:44.694 | +functions-common:screen_process:1502 local group= 2017-10-27 11:25:44.698 | +functions-common:screen_process:1504 SCREEN_NAME=stack 2017-10-27 11:25:44.702 | +functions-common:screen_process:1505 SERVICE_DIR=/opt/stack/status 2017-10-27 11:25:44.707 | +functions-common:screen_process:1507 screen -S stack -X screen -t q-svc 2017-10-27 11:25:44.714 | +functions-common:screen_process:1509 local logfile=q-svc.log.2017-10-27-161116 2017-10-27 11:25:44.719 | +functions-common:screen_process:1510 local real_logfile=/home/stack/devstack/log/q-svc.log.2017-10-27-161116 2017-10-27 11:25:44.724 | +functions-common:screen_process:1511 echo 'LOGDIR: /home/stack/devstack/log' 2017-10-27 11:25:44.724 | LOGDIR: /home/stack/devstack/log 2017-10-27 11:25:44.728 | +functions-common:screen_process:1512 echo 'SCREEN_LOGDIR: /home/stack/devstack/log/screens' 2017-10-27 11:25:44.728 | SCREEN_LOGDIR: /home/stack/devstack/log/screens 2017-10-27 11:25:44.732 | +functions-common:screen_process:1513 echo 'log: /home/stack/devstack/log/q-svc.log.2017-10-27-161116' 2017-10-27 11:25:44.732 | log: /home/stack/devstack/log/q-svc.log.2017-10-27-161116 2017-10-27 11:25:44.736 | +functions-common:screen_process:1514 [[ -n /home/stack/devstack/log ]] 2017-10-27 11:25:44.741 | +functions-common:screen_process:1515 [[ True == \T\r\u\e ]] 2017-10-27 11:25:44.746 | +functions-common:screen_process:1516 screen -S stack -p q-svc -X logfile /home/stack/devstack/log/q-svc.log.2017-10-27-161116 2017-10-27 11:25:44.752 | +functions-common:screen_process:1517 screen -S stack -p q-svc -X log on 2017-10-27 11:25:44.759 | +functions-common:screen_process:1520 touch /home/stack/devstack/log/q-svc.log.2017-10-27-161116 2017-10-27 11:25:44.764 | +functions-common:screen_process:1521 bash -c 'cd '\''/home/stack/devstack/log'\'' && ln -sf '\''q-svc.log.2017-10-27-161116'\'' q-svc.log' 2017-10-27 11:25:44.771 | +functions-common:screen_process:1522 [[ -n /home/stack/devstack/log/screens ]] 2017-10-27 11:25:44.775 | +functions-common:screen_process:1524 ln -sf /home/stack/devstack/log/q-svc.log.2017-10-27-161116 /home/stack/devstack/log/screens/screen-q-svc.log 2017-10-27 11:25:44.781 | +functions-common:screen_process:1536 sleep 3 2017-10-27 11:25:47.788 | ++functions-common:screen_process:1538 echo -ne '\015' 2017-10-27 11:25:47.793 | +functions-common:screen_process:1538 NL=$'\r' 2017-10-27 11:25:47.798 | +functions-common:screen_process:1548 [[ -n '' ]] 2017-10-27 11:25:47.803 | +functions-common:screen_process:1553 screen_rc q-svc '/usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/opencontrail/ContrailPlugin.ini' 2017-10-27 11:25:47.807 | +functions-common:screen_rc:1562 SCREEN_NAME=stack 2017-10-27 11:25:47.812 | +functions-common:screen_rc:1563 SCREENRC=/home/stack/devstack/stack-screenrc 2017-10-27 11:25:47.816 | +functions-common:screen_rc:1564 [[ ! -e /home/stack/devstack/stack-screenrc ]] 2017-10-27 11:25:47.821 | +functions-common:screen_rc:1574 grep q-svc /home/stack/devstack/stack-screenrc 2017-10-27 11:25:47.828 | ++functions-common:screen_rc:1575 echo -ne '\015' 2017-10-27 11:25:47.833 | +functions-common:screen_rc:1575 NL=$'\r' 2017-10-27 11:25:47.837 | +functions-common:screen_rc:1576 echo 'screen -t q-svc bash' 2017-10-27 11:25:47.842 | +functions-common:screen_rc:1577 echo 'stuff "/usr/local/bin/neutron-server --config-file /etc/neutron/neutr"'.conf --config-file /etc/neutron/plugins/opencontrail/ContrailPlugin.ini 2017-10-27 11:25:47.846 | +functions-common:screen_rc:1579 [[ -n /home/stack/devstack/log ]] 2017-10-27 11:25:47.851 | +functions-common:screen_rc:1579 [[ True == \T\r\u\e ]] 2017-10-27 11:25:47.858 | +functions-common:screen_rc:1580 echo 'logfile /home/stack/devstack/log/q-svc.log.2017-10-27-161116' 2017-10-27 11:25:47.862 | +functions-common:screen_rc:1581 echo 'log on' 2017-10-27 11:25:47.867 | +functions-common:screen_process:1555 screen -S stack -p q-svc -X stuff '/usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/opencontrail/ContrailPlugin.ini & echo $! >/opt/stack/status/stack/q-svc.pid; f' || echo "q-svc failed to start" | tee "/opt/stack/status/stack/q-svc.failure" 2017-10-27 11:25:47.873 | +functions-common:run_process:1490 time_stop run_process 2017-10-27 11:25:47.877 | +functions-common:time_stop:2398 local name 2017-10-27 11:25:47.882 | +functions-common:time_stop:2399 local end_time 2017-10-27 11:25:47.886 | +functions-common:time_stop:2400 local elapsed_time 2017-10-27 11:25:47.890 | +functions-common:time_stop:2401 local total 2017-10-27 11:25:47.894 | +functions-common:time_stop:2402 local start_time 2017-10-27 11:25:47.898 | +functions-common:time_stop:2404 name=run_process 2017-10-27 11:25:47.903 | +functions-common:time_stop:2405 start_time=1509103544 2017-10-27 11:25:47.907 | +functions-common:time_stop:2407 [[ -z 1509103544 ]] 2017-10-27 11:25:47.913 | ++functions-common:time_stop:2410 date +%s 2017-10-27 11:25:47.919 | +functions-common:time_stop:2410 end_time=1509103547 2017-10-27 11:25:47.924 | +functions-common:time_stop:2411 elapsed_time=3 2017-10-27 11:25:47.928 | +functions-common:time_stop:2412 total=14 2017-10-27 11:25:47.932 | +functions-common:time_stop:2414 _TIME_START[$name]= 2017-10-27 11:25:47.936 | +functions-common:time_stop:2415 _TIME_TOTAL[$name]=17 2017-10-27 11:25:47.940 | +lib/neutron-legacy:start_neutron_service_and_check:483 echo 'Waiting for Neutron to start...' 2017-10-27 11:25:47.940 | Waiting for Neutron to start... 2017-10-27 11:25:47.951 | +lib/neutron-legacy:start_neutron_service_and_check:484 is_ssl_enabled_service neutron 2017-10-27 11:25:47.955 | +lib/tls:is_ssl_enabled_service:381 local services=neutron 2017-10-27 11:25:47.960 | +lib/tls:is_ssl_enabled_service:382 local service= 2017-10-27 11:25:47.964 | +lib/tls:is_ssl_enabled_service:383 '[' False == False ']' 2017-10-27 11:25:47.969 | +lib/tls:is_ssl_enabled_service:384 return 1 2017-10-27 11:25:47.973 | +lib/neutron-legacy:start_neutron_service_and_check:488 local 'testcmd=wget --no-proxy -q -O- http://192.168.50.9:9696' 2017-10-27 11:25:47.980 | +lib/neutron-legacy:start_neutron_service_and_check:489 test_with_retry 'wget --no-proxy -q -O- http://192.168.50.9:9696' 'Neutron did not start' 60 2017-10-27 11:25:47.985 | +functions-common:test_with_retry:2336 local 'testcmd=wget --no-proxy -q -O- http://192.168.50.9:9696' 2017-10-27 11:25:47.989 | +functions-common:test_with_retry:2337 local 'failmsg=Neutron did not start' 2017-10-27 11:25:47.993 | +functions-common:test_with_retry:2338 local until=60 2017-10-27 11:25:47.997 | +functions-common:test_with_retry:2339 local sleep=0.5 2017-10-27 11:25:48.002 | +functions-common:test_with_retry:2341 time_start test_with_retry 2017-10-27 11:25:48.006 | +functions-common:time_start:2384 local name=test_with_retry 2017-10-27 11:25:48.010 | +functions-common:time_start:2385 local start_time= 2017-10-27 11:25:48.014 | +functions-common:time_start:2386 [[ -n '' ]] 2017-10-27 11:25:48.020 | ++functions-common:time_start:2389 date +%s 2017-10-27 11:25:48.025 | +functions-common:time_start:2389 _TIME_START[$name]=1509103548 2017-10-27 11:25:48.029 | +functions-common:test_with_retry:2342 timeout 60 sh -c 'while ! wget --no-proxy -q -O- http://192.168.50.9:9696; do sleep 0.5; done' 2017-10-27 11:26:48.036 | +functions-common:test_with_retry:2343 die 2343 'Neutron did not start' 2017-10-27 11:26:48.040 | +functions-common:die:186 local exitcode=0 2017-10-27 11:26:48.045 | [Call Trace] 2017-10-27 11:26:48.045 | ./stack.sh:1251:start_neutron_service_and_check 2017-10-27 11:26:48.045 | /home/stack/devstack/lib/neutron-legacy:489:test_with_retry 2017-10-27 11:26:48.045 | /home/stack/devstack/functions-common:2343:die 2017-10-27 11:26:48.047 | [ERROR] /home/stack/devstack/functions-common:2343 Neutron did not start 2017-10-27 11:26:49.050 | Error on exit