ssec / sift

A visualization application for satellite imagery
http://sift.ssec.wisc.edu/
GNU General Public License v3.0
49 stars 14 forks source link

Trying to run SIFT on imaginator.ssec.wisc.edu ? #313

Open jpnIII opened 3 years ago

jpnIII commented 3 years ago

Greetings, all -- SIFT newbie here. I am not sure where one should submit a SIFT question, but I thought this looked to be as good of a spot as any. So here goes ... I thought that I would try to install/run SIFT on imaginator.ssec.wisc.edu. I believe that the installation went fairly seamlessly, but when I tried to start SIFT up, I ran into problems. I am working from home, interfacing with imaginator as user "gops" via a SecureCRT session that was initiated via RemoteDesktop on my Dell laptop at home. I am using the Xming X-server.

FYI, I know that Tim Schmit has been able to run SIFT from his home, but I am not sure how he did it.

Thank you for any help/info. you can provide!

Sincerely,

Jim

gops@imaginator.ssec.wisc.edu:/home/shared/bin/SIFT_1.1.6 ls bin/ conda-meta/ etc/ lib/ man/ phrasebooks/ qml/ resources/ share/ ssl/ var/ x86_64-conda-linux-gnu/ compiler_compat/ doc/ include/ libexec/ mkspecs/ plugins/ qsci/ sbin/ SIFT.sh* translations/ x86_64-conda_cos6-linux-gnu/ gops@imaginator.ssec.wisc.edu:/home/shared/bin/SIFT_1.1.6
gops@imaginator.ssec.wisc.edu:/home/shared/bin/SIFT_1.1.6 SIFT.sh Running one-time initialization of SIFT installation... Running SIFT... INFO 19:29:04 init:check_grib_definition_dir:L43 Setting GRIB definition path to /home/shared/bin/SIFT_1.1.6/lib/python3.7/site-packages/uwsift/data/grib_definitions:/home/shared/bin/SIFT_1.1.6/share/eccodes/definitions INFO 19:29:04 main:main:L1181 Using configuration directory: /home/gops/.config/SIFT/settings INFO 19:29:04 main:main:L1182 Using cache directory: None WARNING: X server does not support XInput 2 WARNING 19:29:04 _qt:message_handler:L187 X server does not support XInput 2 WARNING: failed to get the current screen resources WARNING 19:29:04 _qt:message_handler:L187 failed to get the current screen resources INFO 19:29:04 main:main:L1191 will search [] for new data periodically INFO 19:29:04 workspace:init:L347 creating new workspace cache at /home/gops/.cache/SIFT/workspace/data_cache INFO 19:29:04 workspace:init:L355 attaching pre-existing workspace at /home/gops/.cache/SIFT/workspace INFO 19:29:04 workspace:_init_create_workspace:L375 initializing database at /home/gops/.cache/SIFT/workspace/_inventory.db INFO 19:29:04 metadatabase:connect:L752 attaching database at sqlite:////home/gops/.cache/SIFT/workspace/_inventory.db INFO 19:29:04 metadatabase:connect:L754 creating database tables INFO 19:29:04 workspace:_init_create_workspace:L380 done with init INFO 19:29:04 workspace:_purge_inaccessible_resources:L431 discarded metadata for 0 orphaned resources INFO 19:29:04 workspace:_purge_orphan_products:L446 discarded metadata for 0 orphaned products INFO 19:29:04 document:init:L1236 Creating settings directory /home/gops/.config/SIFT/settings INFO 19:29:04 composite_recipes:init:L104 creating new composite recipes directory at /home/gops/.config/SIFT/settings/composite_recipes WARNING: Application calling GLX 1.3 function "glXCreatePbuffer" when GLX 1.3 is not supported! This is an application bug! INFO 19:29:04 scene_graph:change_tool:L851 Changing tool to 'Tool.PAN_ZOOM' INFO 19:29:04 visuals:init:L1122 Loading boundaries: 2021-07-09 19:29:04.540158 INFO 19:29:04 visuals:init:L1154 Done loading boundaries: 2021-07-09 19:29:04.660229 INFO 19:29:04 visuals:init:L1122 Loading boundaries: 2021-07-09 19:29:04.663187 INFO 19:29:04 visuals:init:L1154 Done loading boundaries: 2021-07-09 19:29:04.694484 ViewBox [STTransform] +--SubScene [MatrixTransform] +--BaseCamera [NullTransform] +--PanZoomProbeCamera: "PAN_ZOOM" [STTransform] +--Node: "HeadNode" [MatrixTransform] +--MainMap: "MainMap" [PROJ4Transform] +--NEShapefileLines [STTransform] +--NEShapefileLines [STTransform] +--Line [STTransform]

[41314:41481:0709/192904.789744:ERROR:gl_surface_glx_qt.cpp(141)] GLX 1.3 or later is required. [41314:41481:0709/192904.789777:ERROR:gl_ozone_glx_qt.cpp(57)] GLSurfaceGLXQt::InitializeOneOff failed. WARNING: QXcbConnection: XCB error: 1 (BadRequest), sequence: 165, resource id: 90, major code: 130 (Unknown), minor code: 47 WARNING 19:29:05 _qt:message_handler:L187 QXcbConnection: XCB error: 1 (BadRequest), sequence: 165, resource id: 90, major code: 130 (Unknown), minor code: 47 WARNING: QXcbConnection: XCB error: 170 (Unknown), sequence: 178, resource id: 90, major code: 146 (Unknown), minor code: 20 WARNING 19:29:05 _qt:message_handler:L187 QXcbConnection: XCB error: 170 (Unknown), sequence: 178, resource id: 90, major code: 146 (Unknown), minor code: 20 SIFT.sh: line 30: 41314 Segmentation fault python -m uwsift "$@"

ScottLindstrom commented 3 years ago

I have only run SIFT on the machine it's installed..that is, never tried to open via a remote window onto another machine. I can run SIFT on my building machines from home by tunneling into them, but that's different from using an xserver.

Sent from my Verizon, Samsung Galaxy smartphone Get Outlook for Androidhttps://aka.ms/AAb9ysg


From: Jim nelson @.> Sent: Friday, July 9, 2021 12:55:25 PM To: ssec/sift @.> Cc: Subscribed @.***> Subject: [ssec/sift] Trying to run SIFT on imaginator.ssec.wisc.edu ? (#313)

Greetings, all -- SIFT newbie here. I am not sure where one should submit a SIFT question, but I thought this looked to be as good of a spot as any. So here goes ... I thought that I would try to install/run SIFT on imaginator.ssec.wisc.edu. I believe that the installation went fairly seamlessly, but when I tried to start SIFT up, I ran into problems. I am working from home, interfacing with imaginator as user "gops" via a SecureCRT session that was initiated via RemoteDesktop on my Dell laptop at home. I am using the Xming X-server.

FYI, I know that Tim Schmit has been able to run SIFT from his home, but I am not sure how he did it.

Thank you for any help/info. you can provide!

Sincerely,

Jim

@.**@.>:/home/shared/bin/SIFT_1.1.6 ls bin/ conda-meta/ etc/ lib/ man/ phrasebooks/ qml/ resources/ share/ ssl/ var/ x86_64-conda-linux-gnu/ compiler_compat/ doc/ include/ libexec/ mkspecs/ plugins/ qsci/ sbin/ SIFT.sh* translations/ x86_64-conda_cos6-linux-gnu/ @.**@.>:/home/shared/bin/SIFT_1.1.6 @.**@.>:/home/shared/bin/SIFT_1.1.6 SIFT.sh Running one-time initialization of SIFT installation... Running SIFT... INFO 19:29:04 init:check_grib_definition_dir:L43 Setting GRIB definition path to /home/shared/bin/SIFT_1.1.6/lib/python3.7/site-packages/uwsift/data/grib_definitions:/home/shared/bin/SIFT_1.1.6/share/eccodes/definitions INFO 19:29:04 main:main:L1181 Using configuration directory: /home/gops/.config/SIFT/settings INFO 19:29:04 main:main:L1182 Using cache directory: None WARNING: X server does not support XInput 2 WARNING 19:29:04 _qt:message_handler:L187 X server does not support XInput 2 WARNING: failed to get the current screen resources WARNING 19:29:04 _qt:message_handler:L187 failed to get the current screen resources INFO 19:29:04 main:main:L1191 will search [] for new data periodically INFO 19:29:04 workspace:init:L347 creating new workspace cache at /home/gops/.cache/SIFT/workspace/data_cache INFO 19:29:04 workspace:init:L355 attaching pre-existing workspace at /home/gops/.cache/SIFT/workspace INFO 19:29:04 workspace:_init_create_workspace:L375 initializing database at /home/gops/.cache/SIFT/workspace/_inventory.db INFO 19:29:04 metadatabase:connect:L752 attaching database at sqlite:////home/gops/.cache/SIFT/workspace/_inventory.db INFO 19:29:04 metadatabase:connect:L754 creating database tables INFO 19:29:04 workspace:_init_create_workspace:L380 done with init INFO 19:29:04 workspace:_purge_inaccessible_resources:L431 discarded metadata for 0 orphaned resources INFO 19:29:04 workspace:_purge_orphan_products:L446 discarded metadata for 0 orphaned products INFO 19:29:04 document:init:L1236 Creating settings directory /home/gops/.config/SIFT/settings INFO 19:29:04 composite_recipes:init:L104 creating new composite recipes directory at /home/gops/.config/SIFT/settings/composite_recipes WARNING: Application calling GLX 1.3 function "glXCreatePbuffer" when GLX 1.3 is not supported! This is an application bug! INFO 19:29:04 scene_graph:change_tool:L851 Changing tool to 'Tool.PAN_ZOOM' INFO 19:29:04 visuals:init:L1122 Loading boundaries: 2021-07-09 19:29:04.540158 INFO 19:29:04 visuals:init:L1154 Done loading boundaries: 2021-07-09 19:29:04.660229 INFO 19:29:04 visuals:init:L1122 Loading boundaries: 2021-07-09 19:29:04.663187 INFO 19:29:04 visuals:init:L1154 Done loading boundaries: 2021-07-09 19:29:04.694484 ViewBox [STTransform] +--SubScene [MatrixTransform] +--BaseCamera [NullTransform] +--PanZoomProbeCamera: "PAN_ZOOM" [STTransform] +--Node: "HeadNode" [MatrixTransform] +--MainMap: "MainMap" [PROJ4Transform] +--NEShapefileLines [STTransform] +--NEShapefileLines [STTransform] +--Line [STTransform]

[41314:41481:0709/192904.789744:ERROR:gl_surface_glx_qt.cpp(141)] GLX 1.3 or later is required. [41314:41481:0709/192904.789777:ERROR:gl_ozone_glx_qt.cpp(57)] GLSurfaceGLXQt::InitializeOneOff failed. WARNING: QXcbConnection: XCB error: 1 (BadRequest), sequence: 165, resource id: 90, major code: 130 (Unknown), minor code: 47 WARNING 19:29:05 _qt:message_handler:L187 QXcbConnection: XCB error: 1 (BadRequest), sequence: 165, resource id: 90, major code: 130 (Unknown), minor code: 47 WARNING: QXcbConnection: XCB error: 170 (Unknown), sequence: 178, resource id: 90, major code: 146 (Unknown), minor code: 20 WARNING 19:29:05 _qt:message_handler:L187 QXcbConnection: XCB error: 170 (Unknown), sequence: 178, resource id: 90, major code: 146 (Unknown), minor code: 20 SIFT.sh: line 30: 41314 Segmentation fault python -m uwsift "$@"

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHubhttps://github.com/ssec/sift/issues/313, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AD3IMP6UDDRHNBSPXEPXDGTTW5H23ANCNFSM5ADLIEFQ.

djhoese commented 3 years ago

@ScottLindstrom When you do it are you doing something like X forwarding (-X/-Y in your ssh command) or are you using remote desktop?

@jpnIII This is probably the best spot and probably what I prefer over emails. Am I correct in assuming you are using a Windows machine as your host computer? My guess is Tim is using a Mac? Does Tim run SIFT from imaginator? I thought he was running it locally on his laptop. Does imaginator have a GPU/video card?

In general, as the software developer who has no real say in what we should be trying to support, I don't expect any of this to work. People just try it and then let us know. SIFT (and vispy) depend heavily on OpenGL. Support for rendering OpenGL elements and sending them through a remote display system like X or remote desktop or even a virtual machine has been really hit or miss in the few times I've tried it. Even when things say they should support a certain version of OpenGL I still can't get things to display correctly.

ScottLindstrom commented 3 years ago

Remote desktop.

-s

Sent from my Verizon, Samsung Galaxy smartphone Get Outlook for Androidhttps://aka.ms/AAb9ysg


From: David Hoese @.> Sent: Monday, July 12, 2021 8:03:04 AM To: ssec/sift @.> Cc: Scott Lindstrom @.>; Mention @.> Subject: Re: [ssec/sift] Trying to run SIFT on imaginator.ssec.wisc.edu ? (#313)

@ScottLindstromhttps://github.com/ScottLindstrom When you do it are you doing something like X forwarding (-X/-Y in your ssh command) or are you using remote desktop?

@jpnIIIhttps://github.com/jpnIII This is probably the best spot and probably what I prefer over emails. Am I correct in assuming you are using a Windows machine as your host computer? My guess is Tim is using a Mac? Does Tim run SIFT from imaginator? I thought he was running it locally on his laptop. Does imaginator have a GPU/video card?

In general, as the software developer who has no real say in what we should be trying to support, I don't expect any of this to work. People just try it and then let us know. SIFT (and vispy) depend heavily on OpenGL. Support for rendering OpenGL elements and sending them through a remote display system like X or remote desktop or even a virtual machine has been really hit or miss in the few times I've tried it. Even when things say they should support a certain version of OpenGL I still can't get things to display correctly.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/ssec/sift/issues/313#issuecomment-878353081, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AD3IMP3EA3CZQ2K2GJRZBXTTXL72RANCNFSM5ADLIEFQ.

jpnIII commented 3 years ago

Hello, Dave and Scott – Thank you for your replies to my inquiry!

1.) Scott – you mentioned “tunneling.” I have heard the term, but don’t understand it, in the context of running on an SSEC computer from my home. Can you share a couple of details about what you mean? Right now, I just use RemoteDesktop to get onto my desktop SSEC PC (zonda.ssec.wisc.edu).

2.) Dave – Please see my enclosed red comments in response to your questions.

Thank you again!

Sincerely,

Jim From: ScottLindstrom @.> Sent: Monday, July 12, 2021 11:44 AM To: ssec/sift @.> Cc: James P. Nelson @.>; Mention @.> Subject: Re: [ssec/sift] Trying to run SIFT on imaginator.ssec.wisc.edu ? (#313)

Remote desktop.

-s

Sent from my Verizon, Samsung Galaxy smartphone Get Outlook for Androidhttps://aka.ms/AAb9ysg


From: David Hoese @.<mailto:@.>> Sent: Monday, July 12, 2021 8:03:04 AM To: ssec/sift @.<mailto:@.>> Cc: Scott Lindstrom @.<mailto:@.>>; Mention @.<mailto:@.>> Subject: Re: [ssec/sift] Trying to run SIFT on imaginator.ssec.wisc.edu ? (#313)

@ScottLindstromhttps://github.com/ScottLindstrom When you do it are you doing something like X forwarding (-X/-Y in your ssh command) or are you using remote desktop?

@jpnIIIhttps://github.com/jpnIII This is probably the best spot and probably what I prefer over emails. Am I correct in assuming you are using a Windows machine as your host computer?

Yes.

My guess is Tim is using a Mac?

I do not know.

Does Tim run SIFT from imaginator?

I also do not know this. I never heard from Tim that he had installed SIFT anywhere on imaginator. However, I installed it a few days ago on that computer.

I thought he was running it locally on his laptop. Does imaginator have a GPU/video card?

I just submitted an inquiry to Technical Computing to try to answer this question.

In general, as the software developer who has no real say in what we should be trying to support, I don't expect any of this to work. People just try it and then let us know. SIFT (and vispy) depend heavily on OpenGL. Support for rendering OpenGL elements and sending them through a remote display system like X or remote desktop or even a virtual machine has been really hit or miss in the few times I've tried it. Even when things say they should support a certain version of OpenGL I still can't get things to display correctly.

Thank you, Dave. My rationale for trying SIFT on imaginator and(or) rci is that both systems have access to the GOES 16/17 Level-1b NetCDF files on /arcdata, and so SIFT would theoretically have ready access to GOES data, without the user having to copy GOES files over from some remote source beforehand.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/ssec/sift/issues/313#issuecomment-878353081, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AD3IMP3EA3CZQ2K2GJRZBXTTXL72RANCNFSM5ADLIEFQ.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/ssec/sift/issues/313#issuecomment-878430047, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AARELF2KDHUKPPJNZZJYVMDTXMLULANCNFSM5ADLIEFQ.

jpnIII commented 3 years ago

Hello again, Dave and Scott – Jesse just informed me that neither imaginator nor rci contain GPUs. So I would imagine this puts the kibosh on using either imaginator or rci for SIFT work?

Jim

From: James P. Nelson @.> Sent: Monday, July 12, 2021 2:35 PM To: ssec/sift @.>; ssec/sift @.> Cc: Mention @.>; James P. Nelson @.>; Tim J Schmit - NOAA Federal @.>; MATHEW M GUNSHOR @.***> Subject: RE: [ssec/sift] Trying to run SIFT on imaginator.ssec.wisc.edu ? (#313)

Hello, Dave and Scott – Thank you for your replies to my inquiry!

1.) Scott – you mentioned “tunneling.” I have heard the term, but don’t understand it, in the context of running on an SSEC computer from my home. Can you share a couple of details about what you mean? Right now, I just use RemoteDesktop to get onto my desktop SSEC PC (zonda.ssec.wisc.edu).

2.) Dave – Please see my enclosed red comments in response to your questions.

Thank you again!

Sincerely,

Jim From: ScottLindstrom @.**@.>> Sent: Monday, July 12, 2021 11:44 AM To: ssec/sift @.**@.>> Cc: James P. Nelson @.**@.>>; Mention @.**@.>> Subject: Re: [ssec/sift] Trying to run SIFT on imaginator.ssec.wisc.edu ? (#313)

Remote desktop.

-s

Sent from my Verizon, Samsung Galaxy smartphone Get Outlook for Androidhttps://aka.ms/AAb9ysg


From: David Hoese @.<mailto:@.>> Sent: Monday, July 12, 2021 8:03:04 AM To: ssec/sift @.<mailto:@.>> Cc: Scott Lindstrom @.<mailto:@.>>; Mention @.<mailto:@.>> Subject: Re: [ssec/sift] Trying to run SIFT on imaginator.ssec.wisc.edu ? (#313)

@ScottLindstromhttps://github.com/ScottLindstrom When you do it are you doing something like X forwarding (-X/-Y in your ssh command) or are you using remote desktop?

@jpnIIIhttps://github.com/jpnIII This is probably the best spot and probably what I prefer over emails. Am I correct in assuming you are using a Windows machine as your host computer?

Yes.

My guess is Tim is using a Mac?

I do not know.

Does Tim run SIFT from imaginator?

I also do not know this. I never heard from Tim that he had installed SIFT anywhere on imaginator. However, I installed it a few days ago on that computer.

I thought he was running it locally on his laptop. Does imaginator have a GPU/video card?

I just submitted an inquiry to Technical Computing to try to answer this question.

In general, as the software developer who has no real say in what we should be trying to support, I don't expect any of this to work. People just try it and then let us know. SIFT (and vispy) depend heavily on OpenGL. Support for rendering OpenGL elements and sending them through a remote display system like X or remote desktop or even a virtual machine has been really hit or miss in the few times I've tried it. Even when things say they should support a certain version of OpenGL I still can't get things to display correctly.

Thank you, Dave. My rationale for trying SIFT on imaginator and(or) rci is that both systems have access to the GOES 16/17 Level-1b NetCDF files on /arcdata, and so SIFT would theoretically have ready access to GOES data, without the user having to copy GOES files over from some remote source beforehand.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/ssec/sift/issues/313#issuecomment-878353081, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AD3IMP3EA3CZQ2K2GJRZBXTTXL72RANCNFSM5ADLIEFQ.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/ssec/sift/issues/313#issuecomment-878430047, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AARELF2KDHUKPPJNZZJYVMDTXMLULANCNFSM5ADLIEFQ.