CVNRneuroimaging / infrastructure

Issue tracking, system documentation and configs for operations side of the neuroimaging core @ Atlanta VA CVNR / Emory University
3 stars 2 forks source link

pano and rama: can't unlock the console #142

Open stowler opened 9 years ago

stowler commented 9 years ago

Keith and Rob,

I'm having intermittent but frequent problems unlocking pano and rama console since this week's upgrade to ubuntu 14.04.

It looks like there are detailed ubuntu bug reports about this, including: https://bugs.launchpad.net/ubuntu/+source/unity/+bug/1311316

...and here are links to some of my lock-up related notes from the last few days:

Please strategize with each other. And please coordinate service intervals with me so that my reboots don't interfere with your troubleshooting and your troubleshooting doesn't interfere with my background jobs.

Thanks, Stephen

cc: @kmcgregor123456 @rrmm

kmcgregor123456 commented 9 years ago

I'd recommend using a single monitor setup until it gets resolved.

stowler commented 9 years ago

Tried it, didn't help. Both hosts, multiple configurations, didn't help.

kmcgregor123456 commented 9 years ago

if lightdm is the thing that is crashing, then disable it, and login to the console and launch X directly.

stowler commented 9 years ago

Lightdm definitely seems to be involved but I don't know whether it's the root cause or just a symptom of something else.

I'm open to any solution that you and Rob @rrmm can get to work reliably. Just be sure to coordinate with me if your testing requires rebooting or anything else that could affect my background jobs.

Thanks.

stowler commented 9 years ago

...I have also seen some suggestions that light locker could be involved, so you may want to include that on your differential.

stowler commented 9 years ago

Keith and Rob: status? I realized I opened this ticket over the weekend but it's now 4p Tuesday. Rebooting to get access to pano and rama's consoles is becoming time consuming. In addition to having to interrupt and resume whatever I'm working on, rama takes a full 10 minutes to reboot.

cc: @kmcgregor123456 @rrmm

stowler commented 9 years ago

Just FYI for your log parsing: final pano reboot before I left WMB today:

[17:13:50]-[stowler-local]-at-[pano]-in-[~]
$ sudo shutdown -r now

...it booted back up to responsive mouse, keyboard, and lightDM, and I left it in its logged-out state.

rrmm commented 9 years ago

does the X server honor ctrl-alt-bkspace or ctrl-alt-f1 ? are you still running the lightdm greeter? are the nvidia drivers up to date?

kmcgregor123456 commented 9 years ago

Change greeter on Ubuntu 14.04 Trusty =<

The Man-Pages for lightdm in ubuntu 14.04 trusty and up showing up a reference to dm-tool This is a tool to mange some Display Mangaer settings and is instlled asside Lightdm. So you can solve your problem with this command

sudo dm-tool --switch-to-greeter

You have to do this from outside an x session. in an init script for instance

Keith McGregor, PhD

VA RR&D Atlanta CoE

Emory University

352.359.8084

www.varrd.emory.edu

From: rrmm [notifications@github.com]

Sent: Tuesday, August 25, 2015 6:59 PM

To: CVNRneuroimaging/infrastructure

Cc: Keith McGregor

Subject: Re: [infrastructure] pano and rama: can't unlock the console (#142)

does the X server honor ctrl-alt-bkspace or ctrl-alt-f1 ?

are you still running the lightdm greeter? �

Reply to this email directly or view it on GitHub.


This e-mail message (including any attachments) is for the sole use of the intended recipient(s) and may contain confidential and privileged information. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this message (including any attachments) is strictly prohibited.

If you have received this message in error, please contact the sender by reply e-mail message and destroy all copies of the original message (including attachments).

stowler commented 9 years ago

Rob:

Keith: Yes, that's a tool to control lightdm, but lightdm is also in various stages of crashed during these lock-ups. Feel free to test dm-tool, just coordinate service window with me if it's going to involve rebooting. Will be running background jobs unless I hear that you need to reboot.

DESCRIPTION
       dm-tool is a tool to communicate with the LightDM display manager.

Thanks guys.

kmcgregor123456 commented 9 years ago

Rob,

could you install a new greeter and test? however, I think Stephen needs the system tonight to run jobs

stowler commented 9 years ago

Keith: just to be clear, are you talking about a new greeter or a new display manager?

Is there something that makes you think changing to another lighdm greeter will help, or are you suggesting that he replace lightdm (which is a display manager, not a DM's greeter)? There's not much to the lightdm greeters, for example:

[21:13:51]-[stowler-local]-at-[rama]-in-[~]
$ cat /etc/lightdm/lightdm-gtk-greeter.conf
#
# background = Background file to use, either an image path or a color (e.g. #772953)
# theme-name = GTK+ theme to use
# icon-theme-name = Icon theme to use
# font-name = Font to use
# xft-antialias = Whether to antialias Xft fonts (true or false)
# xft-dpi = Resolution for Xft in dots per inch (e.g. 96)
# xft-hintstyle = What degree of hinting to use (none, slight, medium, or hintfull)
# xft-rgba = Type of subpixel antialiasing (none, rgb, bgr, vrgb or vbgr)
# show-indicators = semi-colon ";" separated list of allowed indicator modules. Built-in indicators include "~a11y", "~language", "~session", "~power". Unity indicators can be represented by short name (e.g. "sound", "power"), service file name, or absolute path
# show-clock (true or false)
# clock-format = strftime-format string, e.g. %H:%M
# keyboard = command to launch on-screen keyboard
# position = main window position: x y
# default-user-image = Image used as default user icon, path or #icon-name
# screensaver-timeout = Timeout (in seconds) until the screen blanks when the greeter is called as lockscreen
#
[greeter]
background=/lib/plymouth/themes/xubuntu-logo/wallpaper.png
theme-name=Greybird
icon-theme-name=elementary-xfce-dark
font-name=Droid Sans 10
xft-antialias=true
xft-dpi=96
xft-hintstyle=slight
xft-rgba=rgb
show-indicators=power;~session;~language;~a11y;~power;
show-clock=true
clock-format=%d %b, %H:%M
keyboard=onboard
kmcgregor123456 commented 9 years ago

The DM and it's just a suggestion to get things moving. I'm tied up on a manuscript right now, so I won't be hands on until later this week.

Keith McGregor, PhD VA RR&D Atlanta CoE Emory University 352.359.8084 www.varrd.emory.edu


From: Stephen Towler [notifications@github.com] Sent: Tuesday, August 25, 2015 9:35 PM To: CVNRneuroimaging/infrastructure Cc: Keith McGregor Subject: Re: [infrastructure] pano and rama: can't unlock the console (#142)

Keith: just to be clear, are you talking about a new greeter or a new display manager?

Is there something that makes you think changing to another lighdm greeter will help, or are you suggesting that he replace lightdm (which is a display manager, not a DM's greeter)? There's not much to the lightdm greeters, for example:

[21:13:51]-[stowler-local]-at-[rama]-in-[~] $ cat /etc/lightdm/lightdm-gtk-greeter.conf #

background = Background file to use, either an image path or a color (e.g. #772953)

theme-name = GTK+ theme to use

icon-theme-name = Icon theme to use

font-name = Font to use

xft-antialias = Whether to antialias Xft fonts (true or false)

xft-dpi = Resolution for Xft in dots per inch (e.g. 96)

xft-hintstyle = What degree of hinting to use (none, slight, medium, or hintfull)

xft-rgba = Type of subpixel antialiasing (none, rgb, bgr, vrgb or vbgr)

show-indicators = semi-colon ";" separated list of allowed indicator modules. Built-in indicators include "~a11y", "~language", "~session", "~power". Unity indicators can be represented by short name (e.g. "sound", "power"), service file name, or absolute path

show-clock (true or false)

clock-format = strftime-format string, e.g. %H:%M

keyboard = command to launch on-screen keyboard

position = main window position: x y

default-user-image = Image used as default user icon, path or #icon-name

screensaver-timeout = Timeout (in seconds) until the screen blanks when the greeter is called as lockscreen

# [greeter] background=/lib/plymouth/themes/xubuntu-logo/wallpaper.png theme-name=Greybird icon-theme-name=elementary-xfce-dark font-name=Droid Sans 10 xft-antialias=true xft-dpi=96 xft-hintstyle=slight xft-rgba=rgb show-indicators=power;~session;~language;~a11y;~power; show-clock=true clock-format=%d %b, %H:%M keyboard=onboard

— Reply to this email directly or view it on GitHubhttps://github.com/CVNRneuroimaging/infrastructure/issues/142#issuecomment-134785924.


This e-mail message (including any attachments) is for the sole use of the intended recipient(s) and may contain confidential and privileged information. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this message (including any attachments) is strictly prohibited.

If you have received this message in error, please contact the sender by reply e-mail message and destroy all copies of the original message (including attachments).

rrmm commented 9 years ago

are folks going to be in the lab, so i can access the machine tomorrow?

stowler commented 9 years ago

I'm waiting to hear back about my afternoon meeting location, but I could be in WMB for at least 8:30-12p. -ST

rrmm commented 9 years ago

ok, i'll drop by around 9:30.

stowler commented 9 years ago

Rob is actively working on pano today, rebooting-at-will. Rama being held in current configuration for now. -ST

rrmm commented 9 years ago

to mitigate the issues:

preventative measures:


on pano:

stowler commented 9 years ago

Rob: Thanks for the work-arounds: it sounds like they'll obviate the reboots, which were the most disruptive part of the bug. Huge help.

Great continued work on pano. If you suspect that your debugging is providing diminishing returns I just want to endorse one of @kmcgregor123456 's suggestions: feel free to uninstall the DM all together if the rest of the OS will tolerate it. "startx" + xscreensaver or some other screen-locking utility is enough for those machines to get their job done for at least the next few weeks.

Through Friday feel free to test that solution or any others on both pano and rama...I'm temporarily re-tasked to work that doesn't require either of those hosts. I'm happy to provide physical access to the lab as needed.

Thanks again.

rrmm commented 9 years ago

you can give pano a try. the recompiled manager hasn't crashed yet, so it might be worthwhile to stress it a bit.

err, or was it stopped ? edit: ehh looks like it's still crashing

stowler commented 9 years ago

Hi Rob @rrmm . If it's OK with you, later tonight I'm going to take over pano and rama until Thursday morning. I need them for Tuesday and Wednesday data reviews, and am going to start mount, read, and prep tonight.

Thanks!

rrmm commented 9 years ago

fine by me