search

PaloAltoNetworks / minemeld-ansible

Ansible playbook for installing MineMeld on Linux
Apache License 2.0
48 stars 48 forks source link

minemeld-ansible stops working after hours #80

Open carlitos2007 opened 5 years ago

carlitos2007 commented 5 years ago

I run through the minemeld-ansible playbook, Minemeld runs fine picks up the local config and all is well. Leave for the day come back the next day and minemeld is no longer running. I then have to run through all the steps to deploy minemeld-ansible again, surely you should only have to run this once?

Describe the bug

Next day come in, open the browser to go to minemeld page and i get this 404 Not Found nginx/1.14.0 (Ubuntu)

look for the services and minemeld-engine and minemeld-web are Fatal

i then re run the minemeld-ansible installer and everything goes back to normal again...

Expected behavior

Current behavior

Possible solution

Steps to reproduce

1. 2. 3. 4.

Screenshots

Context

Your Environment

jtschichold commented 5 years ago

Could you check /opt/minemeld/log/minemeld-engine.log and /opt/minemeld/log/minemeld-web.log for hints when this happens again?

carlitos2007 commented 5 years ago

i have redepoyed minemeld-ansible and i am online again. I should have the logs tomorrow once it goes bad again.

carlitos2007 commented 5 years ago

in the meantime here are the current logs. minemeld-engine.log minemeld-web.log

carlitos2007 commented 5 years ago

And here we go. Its down root@nytucana:/opt/minemeld-ansible# sudo -u minemeld /opt/minemeld/engine/current/bin/supervisorctl -c /opt/minemeld/supervisor/config/supervisord.conf status minemeld-engine RUNNING pid 11872, uptime 23:57:33 minemeld-supervisord-listener RUNNING pid 11671, uptime 1 day, 0:41:13 minemeld-traced RUNNING pid 11861, uptime 1 day, 0:00:40.

apparently still up according to the above but browsing to the URL i get: 404 Not Found nginx/1.14.0 (Ubuntu)

Looking at logs before hand. minemeld-engine.log minemeld-web.log

and after logs when restarting minemeld-engine and minemeld-web root@nytucana:/opt/minemeld-ansible# sudo -u minemeld /opt/minemeld/engine/current/bin/supervisorctl -c /opt/minemeld/supervisor/config/supervisord.conf status minemeld-engine RUNNING pid 15397, uptime 0:00:39 minemeld-supervisord-listener RUNNING pid 11671, uptime 1 day, 0:43:59 minemeld-traced RUNNING pid 11861, uptime 1 day, 0:03:26 minemeld-web RUNNING pid 11674, uptime 1 day, 0:43:59 root@nytucana:/opt/minemeld-ansible# sudo -u minemeld /opt/minemeld/engine/current/bin/supervisorctl -c /opt/minemeld/supervisor/config/supervisord.conf restart minemeld-web minemeld-web: stopped minemeld-web: ERROR (abnormal termination) root@nytucana:/opt/minemeld-ansible# sudo -u minemeld /opt/minemeld/engine/current/bin/supervisorctl -c /opt/minemeld/supervisor/config/supervisord.conf status minemeld-engine STARTING minemeld-supervisord-listener RUNNING pid 11671, uptime 1 day, 0:44:46 minemeld-traced RUNNING pid 11861, uptime 1 day, 0:04:13 minemeld-web FATAL Exited too quickly (process log may have details) root@nytucana:/opt/minemeld-ansible# sudo -u minemeld /opt/minemeld/engine/current/bin/supervisorctl -c /opt/minemeld/supervisor/config/supervisord.conf status minemeld-engine STARTING minemeld-supervisord-listener RUNNING pid 11671, uptime 1 day, 0:44:53 minemeld-traced RUNNING pid 11861, uptime 1 day, 0:04:20 minemeld-web FATAL Exited too quickly (process log may have details) minemeld-engine-after-restart.log minemeld-web-after-restart.log

carlitos2007 commented 5 years ago

Could you check /opt/minemeld/log/minemeld-engine.log and /opt/minemeld/log/minemeld-web.log for hints when this happens again?

Did you see my note?