desihub / desisim

DESI simulations
BSD 3-Clause "New" or "Revised" License
16 stars 22 forks source link

Failure on jupyter at nersc trying to run redrock on desisim outputs #567

Closed forero closed 2 years ago

forero commented 2 years ago

I am trying to update this notebook to make it work under kernel 22.2: https://github.com/desihub/tutorials/blob/52d61df9d4baa603863ff73399d6525e68c820fc/simulating-desi-spectra.ipynb

That notebook generates a series of QSO spectra and then tries to run redrock on them:

rrdesi -i /global/cscratch1/sd/forero/desi/simspec/qso-observed-spectra.fits -o /global/cscratch1/sd/forero/desi/simspec/qso-zbest.fits

That command gives me the following error

Proc 0: KeyError: "Extension 'SCORES' not found."

I am guessing that this is a problem with the desisim output, but I am not sure. Any idea on what could be the problem? The notebook linked above has the full error message.

sbailey commented 2 years ago

Unfortunately the 22.2 software release has an incompatibility between simulated QSOs and redrock. See #565 and desihub/redrock#205. If someone can fix this in the next few days, we could include them in a new tag and have the tutorial use the new tag instead of the 22.2 kernel.

It would be especially useful if someone contributes a test in desisim that confirms that the simulated output can be processed by redrock to avoid this kind of problem in the future.

forero commented 2 years ago

Thanks, @sbailey !