desihub / desispec

DESI spectral pipeline
BSD 3-Clause "New" or "Revised" License
36 stars 23 forks source link

dashboard shows unknown for job that should be known #2408

Open akremin opened 3 weeks ago

akremin commented 3 weeks ago

On Nov 5th 2024 in daily a tile was observed on two exposures. The first was good, but the second had low exposure time (aborted) and was only run through sky subtractions. The column coloring is all correct but the status shows as "unknown" and is colored orange for the skysub exposure. Below is a screenshot. We should fix the dashboard to do the correct thing in this case.

image
akremin commented 1 week ago

The issue was that for this tile and 2 other examples I found, the skysub exposure was not in the processing_table for the tile but was rather in the unprocessed_table.

My hypothesis is that desi_proc_night was run without --daily mode, such that the script would not submit skysub jobs. However, that doesn't explain why the outputs exist on disk, as I would have expected them to have been removed if the tile was purged.

Because I don't have an explanation for the root cause, I will leave this ticket open, even if the issue is not in the dashboard.