search

ODM2 / ODM2DataSharingPortal

A Python-Django web application enabling users to upload, share, and display data from their environmental monitoring sites via the app's ODM2 database. Data can either be automatically streamed from Internet of Things (IoT) devices, manually uploaded via CSV files, or manually entered into forms.
BSD 3-Clause "New" or "Revised" License
31 stars 8 forks source link

monitor my watershed won't load, just spins #477

Closed dbressler75 closed 3 years ago

dbressler75 commented 4 years ago

error_monmw_wontload

dbressler75 commented 4 years ago

Problem seems to have resolved itself

HeatherBrooks commented 4 years ago

@dbressler75 @aufdenkampe As of 19:30 EDT, site is not loading. Reported on the EnviroDIY forum by Matt Barney. I was able to replicate the issue. image

mbarneytu commented 4 years ago

The site is not loading again, as of 8:54am MDT.

HeatherBrooks commented 4 years ago

@aufdenkampe @htaolimno @tslawecki Any insight on this sporadic site loading issue? Anthony and I were both able to reach the site shortly before @mbarneytu commented that he couldn't. I checked when I saw Matt's comment and I couldn't connect; just a few minutes later I'm able to connect again.

tslawecki commented 4 years ago

Following the comment from @mbarneytu, I tried to connect to the web site and also did not succeed. I logged in to the server and saw that logs were reflecting continued activity throughout the apparent outage. Out of "an abundance of caution", I restarted the nginx, envirodiy, and tsa services. I noticed, however, that my earlier attempted connection had resolved successfully - possibly before the restart. I was also, of course, successful with a separate new website connection.

So, in summary, I don't yet know what to make of it - we have a self-resolving won't load, a won't load directly tied to a known internet outage, and this most recent one. I'll start by adding an Uptime Robot monitor, and also do a little diging into logs.

aufdenkampe commented 4 years ago

This is fixed at the moment, but we've definitely had a bunch of server-side issues in the last few days. Part of the issue was a 5.5 hour internet outage to our servers caused by a Comcast fiber-optic line issue on March 31 in the afternoon. But we’ve had other issues that we’re trying to track down.

If this happens to you again, please run a traceroute or tracert command from your computer and send us the results (maybe in an email to me). See https://en.wikipedia.org/wiki/Traceroute

I’m connecting this to the related discussion on the EnviroDIY forums at https://www.envirodiy.org/topic/response-code-504-from-data-envirodiy-org/

dbressler75 commented 4 years ago

@aufdenkampe this issue has appeared again. Seems to be the same with the entire monmw page not loading, "ERR_CONNECTION_TIMED_OUT". Emailing tracert to Anthony

tslawecki commented 4 years ago

This is a server issue. LTI-IT is investigating.

From: dbressler75 notifications@github.com Sent: Thursday, May 14, 2020 8:41 AM To: ODM2/ODM2DataSharingPortal ODM2DataSharingPortal@noreply.github.com Cc: Tad Slawecki tslawecki@limno.com; Mention mention@noreply.github.com Subject: Re: [ODM2/ODM2DataSharingPortal] monitor my watershed won't load, just spins (#477)

@aufdenkampehttps://github.com/aufdenkampe this issue has appeared again. Seems to be the same with the entire monmw page not loading, "ERR_CONNECTION_TIMED_OUT". Emailing tracert to Anthony

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/ODM2/ODM2DataSharingPortal/issues/477#issuecomment-628607423, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ABH3OPU47CHNO4EJLDJZO3LRRPRHNANCNFSM4LXVRUKA.

tslawecki commented 4 years ago

The EnviroDIY VMs are now up and running. LTI-IT reports that the virtual host server rebooted unexpectedly around 1 AM, and did not restart the VMs. They are looking for the cause.