askap-craco / CELEBI

The CRAFT Effortless Localisation and Enhanced Burst Inspection Pipeline
MIT License
4 stars 2 forks source link

Loadfits: table type GN is of zero length #452

Closed marcinglowacki closed 1 year ago

marcinglowacki commented 1 year ago

Loadfits process had falled over due to a 'type GN is of zero length' error:

_Error executing process > 'frb:corr_rfi:loadfits'

Caused by: Process frb:corr_rfi:loadfits terminated with an error exit status (1)

Command executed: (...)

Command output: FITLD1: Current file has 0 visibilities FITLD1: File ref. freq: 1391.50 MHz FITLD1: 0 vis. written FITLD1: Warning: table type GN is of zero length _


_FITLD1: Sorry this file has no data - it must die FITLD1: Destroyed 1 extension files of type GC FITLD1: Destroyed 1 extension files of type CQ FITLD1: Destroyed 1 extension files of type SU FITLD1: Destroyed 1 extension files of type AN FITLD1: Destroyed 1 extension files of type FQ FITLD1: Destroyed 1 extension files of type NX FITLD1: Destroyed 1 extension files of type GM FITLD1: Destroyed 1 extension files of type MC FITLD1: Destroyed 1 extension files of type CT FITLD1: Destroyed 1 extension files of type IM FITLD1: Destroyed 1 extension files of type AT FITLD1: Destroyed 1 extension files of type HI FITLD1: Destroyed UV image file: catno= 8 disk= 1 FITLD1: TABINI: REQUESTED CH FILE 1 DOES NOT EXIST FITLD1: TABINI: ERROR ON TYPE CH DISK 1 CNO 8 VERSION 1 FITLD1: FRQFID: ERROR 2 FROM CHNDAT OPCODE = READ FITLD1: ERROR 2 RETURNED FROM FRQFID FITLD1: Purports to die of UNNATURAL causes FITLD1: localhos 31DEC22 TST: Cpu= 0.1 Real= 3 IO= 3 Traceback (most recent call last): File "/fred/oz002/askap/craft/craco/craft/parseltongue/loadfits.py", line 221, in fitld_uvfits(fits, uvdata, args.antlist, args.specav) File "/fred/oz002/askap/craft/craco/craft/parseltongue/loadfits.py", line 80, in fitld_uvfits fitld() File "/fred/oz002/askap/craft/craco/parsel3-adam/share/parseltongue/python/AIPSTask.py", line 463, in call return self.go() File "/fred/oz002/askap/craft/craco/parsel3-adam/share/parseltongue/python/AIPSTask.py", line 445, in go self.wait(proxy, tid) File "/fred/oz002/askap/craft/craco/parsel3-adam/share/parseltongue/python/AIPSTask.py", line 397, in wait outputdict = inst.wait(tid) File "/fred/oz002/askap/craft/craco/parsel3-adam/share/parseltongue/python/Proxy/AIPSTask.py", line 395, in wait raise RuntimeError(msg) RuntimeError: Task 'fitld' returns '2'

This was attributed to the FRB running off the edge of data in card 7 in this case, and so was falling off the edge of the window. Removing the cards affected via going to the config file and adding e.g.:

params.cards = ["1", "2", "3", "4", "5", "6"]

to the config file.

marcinglowacki commented 1 year ago

Note you can also see errors like this for cards that are smaller than expected and end up missing the FRB:

_Error executing process > 'pcal:corr_pcal:loadfits'

Caused by: Process pcal:corr_pcal:loadfits terminated with an error exit status (1) (...) Traceback (most recent call last): File "/fred/oz002/askap/craft/craco/craft/parseltongue/loadfits.py", line 221, in fitld_uvfits(fits, uvdata, args.antlist, args.specav) File "/fred/oz002/askap/craft/craco/craft/parseltongue/loadfits.py", line 105, in fitld_uvfits avspc() File "/fred/oz002/askap/craft/craco/parsel3-adam/share/parseltongue/python/AIPSTask.py", line 463, in call return self.go() File "/fred/oz002/askap/craft/craco/parsel3-adam/share/parseltongue/python/AIPSTask.py", line 445, in go self.wait(proxy, tid) File "/fred/oz002/askap/craft/craco/parsel3-adam/share/parseltongue/python/AIPSTask.py", line 397, in wait output_dict = inst.wait(tid) File "/fred/oz002/askap/craft/craco/parsel3-adam/share/parseltongue/python/Proxy/AIPSTask.py", line 395, in wait raise RuntimeError(msg) RuntimeError: Task 'avspc' returns '8'

Work dir: /fred/oz002/askap/craft/craco/processing/work/210407/32/6a4840123daa6c3651f5348aec1da8_

You can check card sizes by going to the work directory and running ls -hs *