search

leginon-org / leginon-redmine-archive

1 stars 0 forks source link

Redux unstable #2586

Open leginonbot opened 8 months ago

leginonbot commented 8 months ago

Author Name: Scott Stagg (Scott Stagg) Original Redmine Issue: 2586, https://emg.nysbc.org/redmine/issues/2586 Original Date: 2013-11-12 Original Assignee: Scott Stagg

I have been having a problem since I updated to redux where the redux server will crash on a fairly regular basis. I would say it crashes 2-3 times per week. I have no idea what is causing the crash. For a while, I thought that it might have something to do with the redux log, but now I'm not so sure. This has become a fairly significant issue for me as there are times when people need Appion, but I am unavailable to restart redux. To answer your first questions, there are no error messages in the log before it crashes, and I don't know if there are any particular actions that cause it to crash.

leginonbot commented 8 months ago

Original Redmine Comment Author Name: Anchi Cheng (@anchi2c) Original Date: 2013-11-12T14:15:42Z

Scott,

I am assigning Sargis on this. He will be able to give you some instruction for checking for logs put out by the system of the webserver. When redux is closed by the webserver before here, there were some information in the server that told us what the problem was.

In the mean time, could you give some details on the system? OS, python, what other thing is the computer for, etc. If ok from your end, we can also do some diagnosis with remote log in if that is a possibility. Our two redux servers have been pretty stable for a while now, so it is likely system specific.

leginonbot commented 8 months ago

Original Redmine Comment Author Name: Scott Stagg (Scott Stagg) Original Date: 2013-11-12T17:33:14Z

OS is red hat 6.3 Python is 2.7.1 myami is 2_2-redux php is 5.2.17 apache is 2.2.15

leginonbot commented 8 months ago

Original Redmine Comment Author Name: Sargis Dallakyan (@dallakyan) Original Date: 2013-11-12T19:49:23Z

We had similar issues with our 2_2-redux server and needed to restart redux nightly. These crashed were logged in /var/log/messages. Jim has fixed this and we had no more crashes in the last 5 to 6 months.

Scott, please do svn update for myami-2.2-redux. You can also use newly created myami-3.0 branch that already includes these changes - https://emg.nysbc.org/redmine/projects/appion/repository/show/branches/myami-3.0

Please let me know if you have questions or need more information.

leginonbot commented 8 months ago

Original Redmine Comment Author Name: Scott Stagg (Scott Stagg) Original Date: 2013-11-13T00:04:43Z

I updated to the most recent version of myami 2_2-redux not long ago. Are there particular logs that you would recommend that I check out to look for error messages?

leginonbot commented 8 months ago

Original Redmine Comment Author Name: Sargis Dallakyan (@dallakyan) Original Date: 2013-11-13T01:06:00Z

I just checked on r17795; it's in the trunk and myami-3.0 branch, but not in the myami-2.2-redux branch. grep reduxd /var/log/messages would show error messages similar to the following:

... kernel: reduxd[11388]: segfault at 39 ip 00007fea8a9ac52d sp 00007fea435f8ce0 error 4 in libfftw3.so.3.2.3[7fea8a993000+f8000]

Updating to myami-3.0 branch would fix this.