caracal-pipeline / caracal

Containerized Automated Radio Astronomy Calibration (CARACal) pipeline
GNU General Public License v2.0
28 stars 6 forks source link

Use multiple `rawdatadir` directories and combine into one MS #1538

Closed SpaceMeerkat closed 9 months ago

SpaceMeerkat commented 9 months ago

From the docs it's clear that you can combine multiple measurement sets using a list of strings in:

getdata > dataid (see here)

But the general worker appears to only support a single rawdatadir (see here).

Is this true or is it possible to combine measurement sets (lets assume they have the same target and calibrators) which are in different directories with different data id's?

Many thanks for any help on this!

paoloserra commented 9 months ago

I think they all need to be in the same rawdatadir indeed.

If they don't you could consider trying with symlinks. I don't know whether that would work -- never tried that.

KshitijT commented 9 months ago

Please see the discussion in #1476 .

SpaceMeerkat commented 9 months ago

Okay yep yep, it seems like it's a case of strictly one rawdatadir to begin with until you have processed files in your local msdir for combining later. Thanks both!