PoonLab / covizu

Rapid analysis and visualization of coronavirus genome variation
https://filogeneti.ca/CoVizu/
MIT License
45 stars 20 forks source link

Proxy errors when trying to access the website #475

Closed bonnielu closed 1 year ago

bonnielu commented 1 year ago

I ran into the following errors when trying to access https://filogeneti.ca/CoVizu/

image

GopiGugan commented 1 year ago

The proxy server could not handle the request Reason: Error during SSL Handshake with remote server

ArtPoon commented 1 year ago

I am able to log into the server via ssh. There are two node processes running 100% CPU each.

ArtPoon commented 1 year ago

Did our SSL certificate expire?

GopiGugan commented 1 year ago

Did our SSL certificate expire?

Could be that the certificate expired for shiny.filogeneti.ca:

image
ArtPoon commented 1 year ago

I can connect to other websites on the server just fine.

ArtPoon commented 1 year ago

I'm getting a different expiry date, did you just do a renewal @GopiGugan ?

GopiGugan commented 1 year ago

It looks like there is a mismatch in certificates:

Navigating to https://filogeneti.ca/covizu/ displays the updated certificate, but accessing filogeneti.ca on the specific port for https requests for Covizu displays the expired certificate.

Looking into which certificate the node server is pointing to

ArtPoon commented 1 year ago

looks like we're back up!

GopiGugan commented 1 year ago

looks like we're back up!

Yes, had to restart the pm2 services. Need to investigate whether the pm2 services need to be restarted to read the updated SSL certificate.

ArtPoon commented 1 year ago

thanks for the heads up @bonnielu

ArtPoon commented 1 year ago

Leaving this issue open until we understand why pm2 failed to load the renewed certificate

GopiGugan commented 1 year ago

This seems to be a known issue https://github.com/Unitech/pm2/issues/5175. We may even be having issues reloading our other data files. The only workaround currently is to completely stop/kill and start pm2.

We should look at alternatives to pm2 for zero downtime deployments until #433 is complete

ArtPoon commented 1 year ago

Let's go with a manual process kill and restart for now, thanks!

ArtPoon commented 1 year ago

Closing this issue, write a new issue to look for a longer term solution (alternative to pm2)