search

caracal-pipeline / caracal

Containerized Automated Radio Astronomy Calibration (CARACal) pipeline
GNU General Public License v2.0
28 stars 6 forks source link

Reading MS' from multiple input rawdatadirs #1476

Closed rstofi closed 1 year ago

rstofi commented 1 year ago

I am trying to process data from several input MS' that sit in different long-term storage folders, and I ideally don't want to move them, but only to read them for processing. I've tried to create a symlink to a shared rawdatadir but it is not working (see https://github.com/caracal-pipeline/caracal/issues/1086) and the rawdatadir only accepts a single path string value. Is there a possible quick solution, or do I have to move the data, with no other solution available?

KshitijT commented 1 year ago

I think the only way is to use one rawdatadir at a time, let it create 'processed' measurement sets (calibrators + fields) in your msdir and then do the selfcal with all the target MSs together.

rstofi commented 1 year ago

Okay, thanks that seems to work well enough for my use case!