spacetelescope / jwst_mast_query

Command line tool for querying MAST and downloading JWST data products
BSD 3-Clause "New" or "Revised" License
18 stars 11 forks source link

Put index.html in correct location when there is no PID subdirectory #17

Open bhilbert4 opened 2 years ago

bhilbert4 commented 2 years ago

from Jo Taylor:

Just tested it for NIRISS commissioning data and it worked great. The only issue I had was when I set skip_propID2outsubdir to True and also made the index.html file. In this case it downloaded all files to outrootdir, but wrote the index.html to outrootdir/PID, with the locations of the jpegs also pointing to the PID subdir, even though they actually existed one directory up in outrootdir. Therefore none of the thumbnails worked.

bhilbert4 commented 2 years ago

While investigating this, I found that the index.html file often has duplicate entries, where everything is the same except for the obsID (NOT the useful one, but the one with value e.g. 71673915) and parent_obsid (which has similar values). I wonder if there's some filtering going on using these columns that instead should use the more traditional obsid (e.g. jw01409103001_02101_00001_nrca1)