Closed viralp closed 1 year ago
JSKenyon
commented
1 year ago Hi @viralp! This type of error usually occurs when an input is incorrectly specified. In this case, it looks like you are using an older command/config file, and output.directory has been deprecated. Instead, use output.gain_directory and output.log_directory to control outputs.
I will, however, look at capturing/formatting these errors to make them easier to understand.
JSKenyon
commented
1 year ago Fixed in #266.
viralp
commented
1 year ago Thanks Jon. It would be better if you provide the latest config file. Well, I made changes in the script but now getting the following error of reading table in ms file. I am testing quartical for JVLA data.
2023-05-24 11:32:57 | ERROR | goquartical:<module> | An error has been caught in function '<module>', process 'MainProcess' (194819), thread 'MainThread' (140115591432000):
Traceback (most recent call last):
> File "/users/vparekh/venv3/bin/goquartical", line 8, in <module>
sys.exit(execute())
│ │ └ <function execute at 0x7f6ee6eb0f70>
│ └ <built-in function exit>
└ <module 'sys' (built-in)>
File "/users/vparekh/venv3/lib/python3.8/site-packages/quartical/executor.py", line 29, in execute
_execute(stack)
│ └ <contextlib.ExitStack object at 0x7f6f340161f0>
└ <function _execute at 0x7f6ee6eb3040>
File "/users/vparekh/venv3/lib/python3.8/site-packages/quartical/executor.py", line 101, in _execute
data_xds_list, ref_xds_list = read_xds_list(model_columns, ms_opts)
│ │ └ MSInputs(path='A168_VLA_L_D_targets_allspw.ms', data_column='CORRECTED_DATA', sigma_column=None, weight_column=None, time_chu...
│ └ {'MODEL_DATA'}
└ <function read_xds_list at 0x7f6eef55ab80>
File "/users/vparekh/venv3/lib/python3.8/site-packages/quartical/data_handling/ms_handler.py", line 31, in read_xds_list
antenna_xds = xds_from_storage_table(ms_opts.path + "::ANTENNA")[0]
│ │ └ 'A168_VLA_L_D_targets_allspw.ms'
│ └ MSInputs(path='A168_VLA_L_D_targets_allspw.ms', data_column='CORRECTED_DATA', sigma_column=None, weight_column=None, time_chu...
└ <function xds_from_storage_table at 0x7f6eef54fe50>
File "/users/vparekh/venv3/lib/python3.8/site-packages/daskms/dask_ms.py", line 339, in xds_from_storage_table
typ = store.type()
│ └ <function DaskMSStore.type at 0x7f6f0dc1de50>
└ DaskMSStore(file:///lustre/aoc/users/vparekh/A168/stimela/quartical/A168_VLA_L_D_targets_allspw.ms::ANTENNA)
File "/users/vparekh/venv3/lib/python3.8/site-packages/daskms/fsspec_store.py", line 82, in type
raise UnknownStoreTypeError(f"Unable to infer table type at {self.full_path}")
└ <class 'daskms.fsspec_store.UnknownStoreTypeError'>
daskms.fsspec_store.UnknownStoreTypeError: Unable to infer table type at /lustre/aoc/users/vparekh/A168/stimela/quartical/A168_VLA_L_D_targets_allspw.ms/ANTENNACould you please check that the MS is at that location? That error usually means the MS wasn't found.
On Fri, 26 May 2023, 20:56 Viral Parekh, @.***> wrote:
Thanks Jon. It would be better if you provide the latest config file. Well, I made changes in the script but now getting the following error of reading table in ms file. I am testing quartical for JVLA data.
2023-05-24 11:32:57 | ERROR | goquartical:
| An error has been caught in function ' ', process 'MainProcess' (194819), thread 'MainThread' (140115591432000): Traceback (most recent call last): File "/users/vparekh/venv3/bin/goquartical", line 8, in
sys.exit(execute()) │ │ └ <function execute at 0x7f6ee6eb0f70> │ └ └ <module 'sys' (built-in)> File "/users/vparekh/venv3/lib/python3.8/site-packages/quartical/executor.py", line 29, in execute _execute(stack) │ └ <contextlib.ExitStack object at 0x7f6f340161f0> └ <function _execute at 0x7f6ee6eb3040> File "/users/vparekh/venv3/lib/python3.8/site-packages/quartical/executor.py", line 101, in _execute data_xds_list, ref_xds_list = read_xds_list(model_columns, ms_opts) │ │ └ MSInputs(path='A168_VLA_L_D_targets_allspw.ms', data_column='CORRECTED_DATA', sigma_column=None, weight_column=None, time_chu... │ └ {'MODEL_DATA'} └ <function read_xds_list at 0x7f6eef55ab80> File "/users/vparekh/venv3/lib/python3.8/site-packages/quartical/data_handling/ms_handler.py", line 31, in read_xds_list antenna_xds = xds_from_storage_table(ms_opts.path + "::ANTENNA")[0] │ │ └ 'A168_VLA_L_D_targets_allspw.ms' │ └ MSInputs(path='A168_VLA_L_D_targets_allspw.ms', data_column='CORRECTED_DATA', sigma_column=None, weight_column=None, time_chu... └ <function xds_from_storage_table at 0x7f6eef54fe50> File "/users/vparekh/venv3/lib/python3.8/site-packages/daskms/dask_ms.py", line 339, in xds_from_storage_table typ = store.type() │ └ <function DaskMSStore.type at 0x7f6f0dc1de50> └ DaskMSStore(file:///lustre/aoc/users/vparekh/A168/stimela/quartical/A168_VLA_L_D_targets_allspw.ms::ANTENNA) File "/users/vparekh/venv3/lib/python3.8/site-packages/daskms/fsspec_store.py", line 82, in type raise UnknownStoreTypeError(f"Unable to infer table type at {self.full_path}") └ <class 'daskms.fsspec_store.UnknownStoreTypeError'> daskms.fsspec_store.UnknownStoreTypeError: Unable to infer table type at /lustre/aoc/users/vparekh/A168/stimela/quartical/A168_VLA_L_D_targets_allspw.ms/ANTENNA
— Reply to this email directly, view it on GitHub https://github.com/ratt-ru/QuartiCal/issues/264#issuecomment-1564799548, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABSHDWN4DRVJYCZHCMOSMLLXID4EJANCNFSM6AAAAAAYMPI3HM . You are receiving this because you modified the open/close state.Message ID: @.***>
JSKenyon
commented
1 year ago Additionally, you can always produce an up-to-date, unpopulated config by running goquartical-config.
Must be a naive query, missing something minor. I am getting the following error message. What does it mean key "directory"?