njcuk9999 / apero-drs

A PipelinE to Reduce Observations - The DRS for SPIRou (CFHT)
MIT License
12 stars 0 forks source link

lbl 0.63.006 in Apero: questions about GET targets with RUN_LBLREF #762

Open larnoldgithub opened 4 months ago

larnoldgithub commented 4 months ago

When running LBL in apero, LBL does a GET at the beginning to get all files for all targets. This is +800 different stars. It takes about 15-20sec per star to find all entries with good QC. So it takes about 4h for the GET to be completed.

But in my lbl_run.ini, I have selected only 2 stars, GL699 and GJ905. Could Apero skip the objects I didn't select and do the GET for only those 2 stars ?

The GET is repeated twice at least when running LBLREF.

Also I see that even with targets like FAKETARGET, TEST, MATTTEST, NOWHERE etc in the reject_list, Apero still includes them in this GET job. Could the query skip those rejected objects ?

njcuk9999 commented 3 months ago

I can look into this, I should really be looking at the SCIENCE_TARGETS in the run.ini file. I'll aim to do this so you don't have to get everything.

Sounds like I need to re-work lbl_ref quite a bit so we can use the calib directory and hard copy things that are linked inside the /red/ directory.