search

DOI-USGS / ISIS3

Integrated Software for Imagers and Spectrometers v3. ISIS3 is a digital image processing software package to manipulate imagery collected by current and past NASA and International planetary missions.
https://isis.astrogeology.usgs.gov
Other
195 stars 166 forks source link

qnet will not open a .lis #4341

Closed shawn-brueshaber closed 3 years ago

shawn-brueshaber commented 3 years ago

ISIS version(s) affected 3.6. MacOS

Description
Attempting to use qnet and it keeps throwing an error about the list:

Error processing cube list.
USER ERROR Can't open or invalid file list [/Users/shawnrb/Desktop/Red_list.lis]. USER ERROR FileName [RED_A09.cub] can not be added to serial number list. USER ERROR Invalid serial number [Unknown] from file [RED_A09.cub].

I have tried copying and pasting the location of the .lis and .cub files to the Desktop from their original location (Desktop/users/shawnrb/Juno_Orbit27/7/file.cub. I've tried changing the names of the .lis and .cub files thinking maybe their original names were too long. I've tried adding their complete file path to the list of cubs as well. Nothing works so far. These cubs open just fine with qview no matter what so I'm very perplexed as to why qnet barfs and I'm dead in the water until I get this figured out.

list name: Red_list.lis. lis contents: RED_A09.cub RED_B10.cub RED_C11.cub

rbeyer commented 3 years ago

I think I've run into something like this. Does your Red_list.lis file end with the "b" in RED_C11.cub, or is there a "carriage return/linefeed" character after it? If not, trying putting one there. If you're creating this file programmatically, you might be putting and end-of-line characters between the elements, but not after the last one.

shawn-brueshaber commented 3 years ago

Hi,

No, this doesn’t appear to be the problem. I literally created a new list file and made certain there were carriage returns after each entry. No dice.

Thanks,

-Shawn

From: Ross Beyer notifications@github.com Reply-To: USGS-Astrogeology/ISIS3 reply@reply.github.com Date: Friday, March 5, 2021 at 12:07 PM To: USGS-Astrogeology/ISIS3 ISIS3@noreply.github.com Cc: "Brueshaber, Shawn (US 3222)" shawn.r.brueshaber@jpl.nasa.gov, Author author@noreply.github.com Subject: [EXTERNAL] Re: [USGS-Astrogeology/ISIS3] qnet will not open a .lis (#4341)

I think I've run into something like this. Does your Red_list.lis file end with the "b" in RED_C11.cub, or is there a "carriage return/linefeed" character after it? If not, trying putting one there. If you're creating this file programmatically, you might be putting and end-of-line characters between the elements, but not after the last one.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://urldefense.us/v3/__https:/github.com/USGS-Astrogeology/ISIS3/issues/4341*issuecomment-791554738__;Iw!!PvBDto6Hs4WbVuu7!b-IuVRjRLjrmnFEruB6KQrtWCGirloHPqJE6-6BPh5ccWkLg2_ZjmwX1QIaEGjPF1SI2KvXuPx0$, or unsubscribehttps://urldefense.us/v3/__https:/github.com/notifications/unsubscribe-auth/ATDIILH7ACNOHOFBIQBFN3TTCEFWJANCNFSM4YVRKFBQ__;!!PvBDto6Hs4WbVuu7!b-IuVRjRLjrmnFEruB6KQrtWCGirloHPqJE6-6BPh5ccWkLg2_ZjmwX1QIaEGjPF1SI2vtc-L6U$.

lwellerastro commented 3 years ago

USER ERROR FileName [RED_A09.cub] can not be added to serial number list. USER ERROR Invalid serial number [Unknown] from file [RED_A09.cub].

Hi @shawn-brueshaber, qnet is specifically complaining about not being able to access/construct a serial number for your image. Qview does not require this information but control network programs do. This sounds like a problem with the data area. Could you run the program getsn and let's us know what your results are. If it is "Unknown" then key files are missing. I won't be able to help you with data area setup issues, but when available one of the developers can. You might poke around other similar posts in the meantime to do some trouble-shooting on your own.

jessemapel commented 3 years ago

It looks like it cannot create a serial number for the image, do you have your data area downloaded properly? Check that $ISISDATA/juno/translations/junoSerialNumber0001.trn exists. It could be that you downloaded the ISIS 4 data area which does not contain these translation files, they were moved into the distribution.

See the Readme for more information

shawn-brueshaber commented 3 years ago

Hi Jesse,

That file is there. Contents are:

ObservationKeys = 4 Group = Keyword1 Auto InputKey = SpacecraftName InputGroup = "IsisCube,Instrument" InputPosition = (IsisCube, Instrument) OutputName = Keyword1 OutputPosition = (Group, SerialNumberKeywords) Translation = (, ) End_Group

Group = Keyword2 Auto InputKey = InstrumentId InputGroup = "IsisCube,Instrument" InputPosition = (IsisCube, Instrument) OutputName = Keyword2 OutputPosition = (Group, SerialNumberKeywords) Translation = (, ) End_Group

Group = Keyword3 Auto InputKey = StartTime InputGroup = "IsisCube,Instrument" InputPosition = (IsisCube, Instrument) OutputName = Keyword3 OutputPosition = (Group, SerialNumberKeywords) Translation = (, ) End_Group

Group = Keyword4 Auto InputKey = FrameletNumber InputGroup = "IsisCube,Instrument" InputPosition = (IsisCube, Instrument) OutputName = Keyword4 OutputPosition = (Group, SerialNumberKeywords) Translation = (, ) End_Group

Group = Keyword5 Auto InputKey = FilterName InputGroup = "IsisCube,BandBin" InputPosition = (IsisCube, BandBin) OutputName = Keyword5 OutputPosition = (Group, SerialNumberKeywords) Translation = (, ) End_Group

End

From: Jesse Mapel notifications@github.com Reply-To: USGS-Astrogeology/ISIS3 reply@reply.github.com Date: Friday, March 5, 2021 at 12:36 PM To: USGS-Astrogeology/ISIS3 ISIS3@noreply.github.com Cc: "Brueshaber, Shawn (US 3222)" shawn.r.brueshaber@jpl.nasa.gov, Mention mention@noreply.github.com Subject: [EXTERNAL] Re: [USGS-Astrogeology/ISIS3] qnet will not open a .lis (#4341)

It looks like it cannot create a serial number for the image, do you have your data area downloaded properly? Check that $ISISDATA/juno/translations/junoSerialNumber0001.trn exists. It could be that you downloaded the ISIS 4 data area which does not contain these translation files, they were moved into the distribution.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://urldefense.us/v3/__https:/github.com/USGS-Astrogeology/ISIS3/issues/4341*issuecomment-791572615__;Iw!!PvBDto6Hs4WbVuu7!cxRS0UDwqAx7ZgJwyJAboDCMkkESxkljXrdFXdhygSl8p9dql2g_12UAco85GUYDGTuXntOZu1Y$, or unsubscribehttps://urldefense.us/v3/__https:/github.com/notifications/unsubscribe-auth/ATDIILDE6EA2ENBR6KSKTMLTCEJDBANCNFSM4YVRKFBQ__;!!PvBDto6Hs4WbVuu7!cxRS0UDwqAx7ZgJwyJAboDCMkkESxkljXrdFXdhygSl8p9dql2g_12UAco85GUYDGTuXG42Vl54$.

shawn-brueshaber commented 3 years ago

Hello,

I got an “unknown” on running that command. I do have the file $ISISDATA/juno/translations/junoSerialNumber0001.trn right where it is supposed to be.

Thanks,

-Shawn

From: lwellerastro notifications@github.com Reply-To: USGS-Astrogeology/ISIS3 reply@reply.github.com Date: Friday, March 5, 2021 at 12:36 PM To: USGS-Astrogeology/ISIS3 ISIS3@noreply.github.com Cc: "Brueshaber, Shawn (US 3222)" shawn.r.brueshaber@jpl.nasa.gov, Mention mention@noreply.github.com Subject: [EXTERNAL] Re: [USGS-Astrogeology/ISIS3] qnet will not open a .lis (#4341)

USER ERROR FileName [RED_A09.cub] can not be added to serial number list. USER ERROR Invalid serial number [Unknown] from file [RED_A09.cub].

Hi @shawn-brueshaberhttps://urldefense.us/v3/__https:/github.com/shawn-brueshaber__;!!PvBDto6Hs4WbVuu7!YEp6YfK-gAOw3sZkOrMJKv0UfCShT4JckYDg_RZ5w6b1RRVidhSg8i62OcZYFuOQMrWujkNokSs$, qnet is specifically complaining about not being able to access/construct a serial number for your image. Qview does not require this information but control network programs do. This sounds like a problem with the data area. Could you run the program getsn and let's us know what your results are. If it is "Unknown" then key files are missing. I won't be able to help you with data area setup issues, but when available one of the developers can. You might poke around other similar posts in the meantime to do some trouble-shooting on your own.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://urldefense.us/v3/__https:/github.com/USGS-Astrogeology/ISIS3/issues/4341*issuecomment-791572589__;Iw!!PvBDto6Hs4WbVuu7!YEp6YfK-gAOw3sZkOrMJKv0UfCShT4JckYDg_RZ5w6b1RRVidhSg8i62OcZYFuOQMrWu48FQ3U8$, or unsubscribehttps://urldefense.us/v3/__https:/github.com/notifications/unsubscribe-auth/ATDIILHW5MKRS2RKZ6M3IGTTCEJC3ANCNFSM4YVRKFBQ__;!!PvBDto6Hs4WbVuu7!YEp6YfK-gAOw3sZkOrMJKv0UfCShT4JckYDg_RZ5w6b1RRVidhSg8i62OcZYFuOQMrWumWu-rHg$.

jessemapel commented 3 years ago

@shawn-brueshaber Can you post the label from the first image?

shawn-brueshaber commented 3 years ago

Hi Jesse,

The first is JNCE_2020154_27C00007_V01_RED_0007.cub and the second is JNCE_2020154_27C00007_V01_RED_0012.cub. I’ve tried using these names and tried simpler ones such as RED7 and RED12.

Both cubs are generated by junocam2isis on JNCE_2020154_27C00007_V01.LBL and then running spiceinit on them. Here are the contents of said label file:

PDS_VERSION_ID = PDS3

/ FILE CHARACTERISTICS /

RECORD_TYPE = FIXED_LENGTH RECORD_BYTES = 1648 FILE_RECORDS = 10752

/ POINTERS TO DATA OBJECTS /

^IMAGE = "JNCE_2020154_27C00007_V01.IMG"

/ IDENTIFICATION DATA ELEMENTS /

FILE_NAME = "JNCE_2020154_27C00007_V01.IMG" SPACECRAFT_NAME = JUNO MISSION_PHASE_NAME = "SCIENCE ORBITS" TARGET_NAME = "JUPITER" INSTRUMENT_ID = "JNC" INSTRUMENT_HOST_NAME = "JUNO" INSTRUMENT_NAME = "JUNO EPO CAMERA" PRODUCER_ID = JUNO_JUNOCAM_TEAM DATA_SET_ID = "JUNO-J-JUNOCAM-2-EDR-L0-V1.0" STANDARD_DATA_PRODUCT_ID = "JUNOCAM-EDR" PRODUCT_CREATION_TIME = 2020-09-30T19:48:03 PRODUCT_VERSION_ID = "01" PRODUCT_ID = "JNCE_2020154_27C00007_V01" SOURCE_PRODUCT_ID = "3D-09001B0007-2020-154T12.50.00" START_TIME = 2020-06-02T09:41:02.680 IMAGE_TIME = 2020-06-02T09:41:02.680 STOP_TIME = 2020-06-02T09:41:13.040 SPACECRAFT_CLOCK_START_COUNT = "644363187:218" SPACECRAFT_CLOCK_STOP_COUNT = "N/A"

/ DESCRIPTIVE DATA ELEMENTS /

ORBIT_NUMBER = 27 SOFTWARE_NAME = "JUNOMAKEPDS.PY 0.9" PROCESSING_LEVEL_ID = "2" FOCAL_PLANE_TEMPERATURE = 255.7 INTERFRAME_DELAY = 0.370 SUB_SPACECRAFT_LATITUDE = 73.1077 SUB_SPACECRAFT_LONGITUDE = 201.1509 SPACECRAFT_ALTITUDE = 50165.1 SOLAR_DISTANCE = 7.7362e+08 SAMPLE_BIT_MODE_ID = "SQROOT" EXPOSURE_DURATION = 28.800000 JNO:TDI_STAGES_COUNT = 9 SAMPLING_FACTOR = 1 FILTER_NAME = ('BLUE', 'GREEN', 'RED') COMPRESSION_TYPE = "INTEGER COSINE TRANSFORM" RATIONALE_DESC = "PJ27 Northern Circumpolar Cyclones (relative time: PJ27-000T00:38)"

/ DATA OBJECT DEFINITIONS /

OBJECT = IMAGE LINES = 10752 LINE_SAMPLES = 1648 SAMPLE_TYPE = UNSIGNED_INTEGER LINE_PREFIX_BYTES = 0 LINE_SUFFIX_BYTES = 0 SAMPLE_BITS = 8 SAMPLE_BIT_MASK = 2#11111111# MD5_CHECKSUM = "e02500c0fe08e7223fd2d58c4f53a181" END_OBJECT = IMAGE END

From: Jesse Mapel notifications@github.com Reply-To: USGS-Astrogeology/ISIS3 reply@reply.github.com Date: Friday, March 5, 2021 at 2:52 PM To: USGS-Astrogeology/ISIS3 ISIS3@noreply.github.com Cc: "Brueshaber, Shawn (US 3222)" shawn.r.brueshaber@jpl.nasa.gov, Mention mention@noreply.github.com Subject: [EXTERNAL] Re: [USGS-Astrogeology/ISIS3] qnet will not open a .lis (#4341)

@shawn-brueshaberhttps://urldefense.us/v3/__https:/github.com/shawn-brueshaber__;!!PvBDto6Hs4WbVuu7!c4zHpcm-ygnwkARgK3xqDGvIerswZQ8dfk2KgEwB8B0lXZuWKEz89aIys1ztudRvIASCkGy6OQY$ Can you post the label from the first image?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://urldefense.us/v3/__https:/github.com/USGS-Astrogeology/ISIS3/issues/4341*issuecomment-791644460__;Iw!!PvBDto6Hs4WbVuu7!c4zHpcm-ygnwkARgK3xqDGvIerswZQ8dfk2KgEwB8B0lXZuWKEz89aIys1ztudRvIASC7VqtQ_Q$, or unsubscribehttps://urldefense.us/v3/__https:/github.com/notifications/unsubscribe-auth/ATDIILD3HTPYJKKRLMMSHJTTCEY6NANCNFSM4YVRKFBQ__;!!PvBDto6Hs4WbVuu7!c4zHpcm-ygnwkARgK3xqDGvIerswZQ8dfk2KgEwB8B0lXZuWKEz89aIys1ztudRvIASCP2qFoFM$.

jessemapel commented 3 years ago

Can you post the cube label from RED_A09.cub?

shawn-brueshaber commented 3 years ago

I’m not sure what you mean “post the cube label.” Can you describe how to go about doing that?

Thanks,

Shawn

From: Jesse Mapel notifications@github.com Reply-To: USGS-Astrogeology/ISIS3 reply@reply.github.com Date: Friday, March 5, 2021 at 4:33 PM To: USGS-Astrogeology/ISIS3 ISIS3@noreply.github.com Cc: "Brueshaber, Shawn (US 3222)" shawn.r.brueshaber@jpl.nasa.gov, Mention mention@noreply.github.com Subject: [EXTERNAL] Re: [USGS-Astrogeology/ISIS3] qnet will not open a .lis (#4341)

Can you post the cube label from one of the cubes?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://urldefense.us/v3/__https:/github.com/USGS-Astrogeology/ISIS3/issues/4341*issuecomment-791723862__;Iw!!PvBDto6Hs4WbVuu7!fV8lJP4umftN3G7vGvRgbn6WdQ9ecdFAkN9dQ2RfLvFaE-VLHcja7ITEfz4yah5QENTOzGK-2yo$, or unsubscribehttps://urldefense.us/v3/__https:/github.com/notifications/unsubscribe-auth/ATDIILHIK2EYNE5STB33ZWDTCFE2FANCNFSM4YVRKFBQ__;!!PvBDto6Hs4WbVuu7!fV8lJP4umftN3G7vGvRgbn6WdQ9ecdFAkN9dQ2RfLvFaE-VLHcja7ITEfz4yah5QENTO6u-JctA$.

jessemapel commented 3 years ago

Run the catlab program on the Cube file to get the Cube label, we don't use the original PDS labels, we transfer most of keywords to a new label that we also add some extra data to.

shawn-brueshaber commented 3 years ago

Hi Jesse,

Ok, I ran catlab on the two cubes I mentioned. The files are attached.

Thanks,

-Shawn

From: Jesse Mapel notifications@github.com Reply-To: USGS-Astrogeology/ISIS3 reply@reply.github.com Date: Friday, March 5, 2021 at 5:40 PM To: USGS-Astrogeology/ISIS3 ISIS3@noreply.github.com Cc: "Brueshaber, Shawn (US 3222)" shawn.r.brueshaber@jpl.nasa.gov, Mention mention@noreply.github.com Subject: [EXTERNAL] Re: [USGS-Astrogeology/ISIS3] qnet will not open a .lis (#4341)

Run the catlab program on the Cube file to get the Cube label, we don't use the original PDS labels, we transfer most of keywords to a new label that we also add some extra data to.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://urldefense.us/v3/__https:/github.com/USGS-Astrogeology/ISIS3/issues/4341*issuecomment-791766195__;Iw!!PvBDto6Hs4WbVuu7!dmbkrhBJlQ1Jskx0UwlS8iRFX5r9px_Qo44vzyJoqnRVTWpPqmq98jjX5j8oeYIS2pf-gte9AH0$, or unsubscribehttps://urldefense.us/v3/__https:/github.com/notifications/unsubscribe-auth/ATDIILHSPQQNUECDJ43IKLDTCFMWZANCNFSM4YVRKFBQ__;!!PvBDto6Hs4WbVuu7!dmbkrhBJlQ1Jskx0UwlS8iRFX5r9px_Qo44vzyJoqnRVTWpPqmq98jjX5j8oeYIS2pf-0O4ncU4$.

jessemapel commented 3 years ago

@shawn-brueshaber I can't see the attachments. You may need to respond on Github directly.

shawn-brueshaber commented 3 years ago

@shawn-brueshaber Do I can't see the attachments. You may need to respond on Github directly.

catlab_RED_0012.txt catlab_RED_0007.txt

jessemapel commented 3 years ago

Here's the issue:

Group = Keyword4
  Auto
  InputKey       = FrameletNumber
  InputGroup     = "IsisCube,Instrument"
  InputPosition  = (IsisCube, Instrument)
  OutputName     = Keyword4
  OutputPosition = (Group, SerialNumberKeywords)
  Translation    = (*, *)
End_Group

Is looking for the keyword FrameletNumber on the cubes, but they have FrameNumber. It looks like this was changed in https://github.com/USGS-Astrogeology/ISIS3/commit/556ca197336b495a1b3bcfd76b0147f50fe5c73e but the serialnumber translation didn't get changed.

@shawn-brueshaber For right now, replace 

  InputKey       = FrameletNumber

with 

  InputKey       = FrameNumber

in $ISISDATA/juno/translations/junoSerialNumber0001.trn

This is still present in dev, even though the bug was reported on 3.6.

shawn-brueshaber commented 3 years ago

Ok, made the change and I’m still getting the same error.

From: Jesse Mapel notifications@github.com Reply-To: USGS-Astrogeology/ISIS3 reply@reply.github.com Date: Monday, March 8, 2021 at 11:19 AM To: USGS-Astrogeology/ISIS3 ISIS3@noreply.github.com Cc: "Brueshaber, Shawn (US 3222)" shawn.r.brueshaber@jpl.nasa.gov, Mention mention@noreply.github.com Subject: [EXTERNAL] Re: [USGS-Astrogeology/ISIS3] qnet will not open a .lis (#4341)

Here's the issue:

Group = Keyword4

Auto

InputKey = FrameletNumber

InputGroup = "IsisCube,Instrument"

InputPosition = (IsisCube, Instrument)

OutputName = Keyword4

OutputPosition = (Group, SerialNumberKeywords)

Translation = (, )

End_Group

Is looking for the keyword FrameletNumber on the cubes, but they have FrameNumber. It looks like this was changed in 556ca19https://urldefense.us/v3/__https:/github.com/USGS-Astrogeology/ISIS3/commit/556ca197336b495a1b3bcfd76b0147f50fe5c73e__;!!PvBDto6Hs4WbVuu7!aNj4JhFifC0We3rd7d2HkO8WsV7WaM36hY4MjRqSvgT03oy4r1KUwz8t6ywyZ4Qy6Dd_qYPMzRo$ but the serialnumber translation didn't get changed.

@shawn-brueshaberhttps://urldefense.us/v3/__https:/github.com/shawn-brueshaber__;!!PvBDto6Hs4WbVuu7!aNj4JhFifC0We3rd7d2HkO8WsV7WaM36hY4MjRqSvgT03oy4r1KUwz8t6ywyZ4Qy6Dd_EhzZyPI$ For right now, replace

InputKey = FrameletNumber

with

InputKey = FrameNumber

in $ISISDATA/juno/translations/junoSerialNumber0001.trn

This is still present in dev, even though the bug was reported on 3.6.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://urldefense.us/v3/__https:/github.com/USGS-Astrogeology/ISIS3/issues/4341*issuecomment-792871117__;Iw!!PvBDto6Hs4WbVuu7!aNj4JhFifC0We3rd7d2HkO8WsV7WaM36hY4MjRqSvgT03oy4r1KUwz8t6ywyZ4Qy6Dd_zr21f3E$, or unsubscribehttps://urldefense.us/v3/__https:/github.com/notifications/unsubscribe-auth/ATDIILGEP46DWR6QSMZCOYDTCT2JXANCNFSM4YVRKFBQ__;!!PvBDto6Hs4WbVuu7!aNj4JhFifC0We3rd7d2HkO8WsV7WaM36hY4MjRqSvgT03oy4r1KUwz8t6ywyZ4Qy6Dd_qLz8okg$.

jessemapel commented 3 years ago

That was all I needed to do for getsn to work with your cube labels in 4.4.0. Can you double check that your translation file looks like the attached translation file (except with .trn as the extension). You can also try installing ISIS 4.4.0 and then modifying the same file at $ISISROOT/appdata/translations/JunoJunoCamSerialNumber.trn. JunoJunoCamSerialNumber.txt

shawn-brueshaber commented 3 years ago

The file name was the problem. I took JunoJunoCamSerialNumber.trn and dropped it into the appropriate directory. There was no such file name there, only JunoSerinalNumber0001.trn. Qnet now allows me to select the list I want.