search

sandialabs / sceptre-phenix

phenix is an orchestration tool and GUI for Sandia's minimega platform
https://sandialabs.github.io/sceptre-docs/
GNU General Public License v3.0
17 stars 23 forks source link

[SOH] c2Timeout not working as expected #20

Open activeshadow opened 3 years ago

activeshadow commented 3 years ago

Originally created by @glattercj on Fri, 12 Feb 2021 22:21:46 GMT

When adding the soh app to a scenario config, if a host doesn't have miniccc running (either not injected properly or didn't start properly), the c2 timeout isn't being respected. The experiment stalls and repeats this on a loop:

  [2021-02-12T14:43:50-07:00] waiting for initial network configurations to be validated...
  [2021-02-12T14:43:55-07:00] waiting for initial network configurations to be validated...
  [2021-02-12T14:44:00-07:00] waiting for initial network configurations to be validated...
  [2021-02-12T14:44:05-07:00] waiting for initial network configurations to be validated...
  [2021-02-12T14:44:10-07:00] waiting for initial network configurations to be validated...
  [2021-02-12T14:44:15-07:00] waiting for initial network configurations to be validated...
  [2021-02-12T14:44:20-07:00] waiting for initial network configurations to be validated...

Note: When the specific node foobar-no-miniccc which does not have miniccc installed/running is added to the skipHosts list, the experiment continues to start as normal.

activeshadow commented 3 years ago

Originally created by @mgaliar on Fri, 09 Apr 2021 13:30:58 GMT

Ran into the same issue. And the only way I could figure out how to kill the loop was restarting the phenix docker container.