caracal-pipeline / caracal

Containerized Automated Radio Astronomy Calibration (CARACal) pipeline
GNU General Public License v2.0
28 stars 6 forks source link

Meq tree fails when running set_model during crosscal #1571

Closed ianjarog closed 4 months ago

ianjarog commented 4 months ago

Hi all,

Does anybody know what causes the attached errors? Looks like it failed at the set_model stage, when trying to import the primary calibrator's local sky model into the MODEL_DATA column.

hcg31_log-caracal.txt

Athanaseus commented 4 months ago

Hi @ianjarog thanks for reporting this issue. It is related to #1316. Try reducing tile_size. Please confirm if the same error persist with a re-run, and after changing the params.

2024-02-13 10:30:23 CARACal INFO:     set_model:
2024-02-13 10:30:23 CARACal INFO:       enable:                       True
2024-02-13 10:30:23 CARACal INFO:       meerkat_band:                 L
2024-02-13 10:30:23 CARACal INFO:       meerkat_skymodel:             True
2024-02-13 10:30:23 CARACal INFO:       meerkat_crystalball_skymodel: False
2024-02-13 10:30:23 CARACal INFO:       meerkat_crystalball_memory_fraction:0.5
2024-02-13 10:30:23 CARACal INFO:       meerkat_crystalball_num_sources:0
2024-02-13 10:30:23 CARACal INFO:       meerkat_crystalball_row_chunks:0
2024-02-13 10:30:23 CARACal INFO:       no_verify:                    False
2024-02-13 10:30:23 CARACal INFO:       field:                        fcal
2024-02-13 10:30:23 CARACal INFO:       tile_size:                    64
2024-02-13 10:30:23 CARACal INFO:       threads:                      4
ianjarog commented 4 months ago

@Athanaseus Thanks, setting it to 8 solved it. I am closing this