marinebon / mbon-dashboard-server

server software for MBON early alert dashboard using Docker
1 stars 2 forks source link

No time series data on FKNMS dash #53

Closed dotis closed 11 months ago

dotis commented 11 months ago

The display of time series data on the FKNMS dash has failed and we are getting the "bad gateway" error. This may be related to 52.

7yl4r commented 11 months ago

This error shows when the InfluxDB can't be reached. Checking in on the server I found the instance is down:

tylarmurray@fknms-dashboard-04:~$ docker container ls -a
CONTAINER ID   IMAGE                                      COMMAND                  CREATED        STATUS                      PORTS                                                 NAMES
[...]
1353c06aedc5   influxdb:1.8                               "/entrypoint.sh infl…"   5 weeks ago    Exited (137) 39 hours ago                                                         influxdb
[...]

Nothing in the logs:

docker logs influxdb

I couldn't find any other logfiles in the directory.

Started the container back up using docker compose:

tylarmurray@fknms-dashboard-04:~/mbon-dashboard-server$ docker compose up -d
[+] Building 0.0s (0/0)                                                                                                                                                              
WARN[0000] Found orphan containers ([erddap]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up. 
[+] Running 11/11
 ✔ Container nginx                                      Running                                                                                                                 0.0s 
 ✔ Container grafana                                    Running                                                                                                                 0.0s 
 ✔ Container mbon-dashboard-server-postgres-1           Healthy                                                                                                                 0.5s 
 ✔ Container mbon_data_uploader                         Running                                                                                                                 0.0s 
 ✔ Container influxdb                                   Started                                                                                                                 0.6s 
 ✔ Container mbon-dashboard-server-redis-1              Healthy                                                                                                                 0.5s 
 ✔ Container mbon-dashboard-server-airflow-scheduler-1  Running                                                                                                                 0.0s 
 ✔ Container mbon-dashboard-server-airflow-init-1       Started                                                                                                                 0.8s 
 ✔ Container mbon-dashboard-server-airflow-worker-1     Running                                                                                                                 0.0s 
 ✔ Container mbon-dashboard-server-flower-1             Running                                                                                                                 0.0s 
 ✔ Container mbon-dashboard-server-airflow-webserver-1  Running                                                                                                                 0.0s 

Checked after 3 min and all looks good again.


Another mystery docker container shutdown like #51. I remain unsure why.