caracal-pipeline / caracal

Containerized Automated Radio Astronomy Calibration (CARACal) pipeline
GNU General Public License v2.0
27 stars 6 forks source link

Tricolor error - ddid = ddid_ds[ds.attrs['DATA_DESC_ID']] # IndexError: list index out of range #1353

Closed viralp closed 11 months ago

viralp commented 3 years ago

In the tricolor worker getting the following error -

# tricolour - 2021-07-01 00:19:12,182 INFO - Adding field '0408-65' scan 1 to compute graph for processing
# tricolour - 2021-07-01 00:19:13,083 INFO - Adding field '0408-65' scan 1 to compute graph for processing
# Traceback (most recent call last):
#   File "/usr/local/bin/tricolour", line 8, in <module>
#     sys.exit(main())
#   File "/usr/local/lib/python3.6/dist-packages/tricolour/apps/tricolour/app.py", line 258, in main
#     _main(args)
#   File "/usr/local/lib/python3.6/dist-packages/tricolour/apps/tricolour/app.py", line 370, in _main
#     ddid = ddid_ds[ds.attrs['DATA_DESC_ID']]
# IndexError: list index out of range
# 2021-07-01 00:19:13: tricolour exited with code 1

log-caracal.txt

bennahugo commented 3 years ago

I believe this has been fixed a long time ago - it probably hasn't been rebuild since in stimela, so I think raise this in stimela.

On Thu, Jul 1, 2021 at 12:41 PM Viral Parekh @.***> wrote:

In the tricolor worker getting the following error -

tricolour - 2021-07-01 00:19:12,182 INFO - Adding field '0408-65' scan 1 to compute graph for processing

tricolour - 2021-07-01 00:19:13,083 INFO - Adding field '0408-65' scan 1 to compute graph for processing

Traceback (most recent call last):

File "/usr/local/bin/tricolour", line 8, in

sys.exit(main())

File "/usr/local/lib/python3.6/dist-packages/tricolour/apps/tricolour/app.py", line 258, in main

_main(args)

File "/usr/local/lib/python3.6/dist-packages/tricolour/apps/tricolour/app.py", line 370, in _main

ddid = ddid_ds[ds.attrs['DATA_DESC_ID']]

IndexError: list index out of range

2021-07-01 00:19:13: tricolour exited with code 1

log-caracal.txt https://github.com/caracal-pipeline/caracal/files/6747464/log-caracal.txt

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/caracal-pipeline/caracal/issues/1353, or unsubscribe https://github.com/notifications/unsubscribe-auth/AB4RE6UWB2XJJT4BXXMYBA3TVRA4BANCNFSM47UHRXEA .

--

Benjamin Hugo

PhD. student, Centre for Radio Astronomy Techniques and Technologies Department of Physics and Electronics Rhodes University

Junior software developer Radio Astronomy Research Group South African Radio Astronomy Observatory Black River Business Park Observatory Cape Town

bennahugo commented 3 years ago

(or could you at least check by running the latest tricolour release in a venv with your parameters. Thanks)

On Thu, Jul 1, 2021 at 2:00 PM Benna Hugo @.***> wrote:

I believe this has been fixed a long time ago - it probably hasn't been rebuild since in stimela, so I think raise this in stimela.

On Thu, Jul 1, 2021 at 12:41 PM Viral Parekh @.***> wrote:

In the tricolor worker getting the following error -

tricolour - 2021-07-01 00:19:12,182 INFO - Adding field '0408-65' scan 1 to compute graph for processing

tricolour - 2021-07-01 00:19:13,083 INFO - Adding field '0408-65' scan 1 to compute graph for processing

Traceback (most recent call last):

File "/usr/local/bin/tricolour", line 8, in

sys.exit(main())

File "/usr/local/lib/python3.6/dist-packages/tricolour/apps/tricolour/app.py", line 258, in main

_main(args)

File "/usr/local/lib/python3.6/dist-packages/tricolour/apps/tricolour/app.py", line 370, in _main

ddid = ddid_ds[ds.attrs['DATA_DESC_ID']]

IndexError: list index out of range

2021-07-01 00:19:13: tricolour exited with code 1

log-caracal.txt https://github.com/caracal-pipeline/caracal/files/6747464/log-caracal.txt

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/caracal-pipeline/caracal/issues/1353, or unsubscribe https://github.com/notifications/unsubscribe-auth/AB4RE6UWB2XJJT4BXXMYBA3TVRA4BANCNFSM47UHRXEA .

--

Benjamin Hugo

PhD. student, Centre for Radio Astronomy Techniques and Technologies Department of Physics and Electronics Rhodes University

Junior software developer Radio Astronomy Research Group South African Radio Astronomy Observatory Black River Business Park Observatory Cape Town

--

Benjamin Hugo

PhD. student, Centre for Radio Astronomy Techniques and Technologies Department of Physics and Electronics Rhodes University

Junior software developer Radio Astronomy Research Group South African Radio Astronomy Observatory Black River Business Park Observatory Cape Town

SpheMakh commented 3 years ago

pinging @SpheMakh

rramij commented 1 year ago

I am getting the same error. The pipeline ran smoothly on a MeerKAT data. But it is now showing this error on a VLA data. How do I solve this problem? FYI, I am running the most recent caracal pipeline (development version).

bennahugo commented 1 year ago

Thanks for the email. Unfortunately Tricolour is specifically built for MeerKAT data processing - aside from not supporting multi-spw data the built in static masking targets the MeerKAT environment, so there will be some work to make this suitable for VLA data processing.

On Fri, 03 Mar 2023, 18:10 Ramij Raja, @.***> wrote:

I am getting the same error. The pipeline ran smoothly on a MeerKAT data. But it is now showing this error on a VLA data. How do I solve this problem? FYI, I am running the most recent caracal pipeline.

— Reply to this email directly, view it on GitHub https://github.com/caracal-pipeline/caracal/issues/1353#issuecomment-1453761129, or unsubscribe https://github.com/notifications/unsubscribe-auth/AB4RE6TZURR6YKSXR5HEWHDW2IJWHANCNFSM47UHRXEA . You are receiving this because you commented.Message ID: @.***>

KshitijT commented 11 months ago

Closing this issue, please reopen if needed. I think @bennahugo 's reply is enough to give clarity on the issue.