search

askap-craco / CELEBI

The CRAFT Effortless Localisation and Enhanced Burst Inspection Pipeline
MIT License
4 stars 2 forks source link

Failed beamforming (due to incomplete data) - invalid read request #453

Open marcinglowacki opened 1 year ago

marcinglowacki commented 1 year ago

For FRB210407, the following error was encountered:

_Error executing process > 'frb:bform_frb:do_beamform (2)'

Caused by: Missing output file(s) 210407_frb_0_X_f.npy expected by process frb:bform_frb:do_beamform (2)

Command executed:

if [ "true" == "true" ]; then

. /fred/oz002/askap/craft/craco/processing/.marcin/../setup_beamform

  . /fred/oz002/askap/craft/craco/processing/.marcin/../setup_proc

fi mkdir delays # needed by craftcor_tab.py tar xvf calibration_noxpol210407.tar.gz

In the .command.log file:

_INFO:root:No delays loaded. None does not exist /fred/oz002/askap/craft/craco/craft-python/vcraft.py:110: UserWarning: VCRAFT file /fred/oz002/askap/craft/craco/processing/data/210407/frb/ak07/beam64/ak07_c4_f0.vcraft had unexpected size. Mode 2 expected 3728256 actual 3229136.5 warnings.warn('VCRAFT file {} had unexpected size. Mode {} expected {} actual {}'.format(self.fname, self.mode, self.expected_nsamp, self.nsamps)) /fred/oz002/askap/craft/craco/craft-python/vcraft.py:110: UserWarning: VCRAFT file /fred/oz002/askap/craft/craco/processing/data/210407/frb/ak07/beam64/ak07_c4_f1.vcraft had unexpected size. Mode 2 expected 3728256 actual 3225042.5 warnings.warn('VCRAFT file {} had unexpected size. Mode {} expected {} actual {}'.format(self.fname, self.mode, self.expected_nsamp, self.nsamps)) /fred/oz002/askap/craft/craco/craft-python/vcraft.py:110: UserWarning: VCRAFT file /fred/oz002/askap/craft/craco/processing/data/210407/frb/ak07/beam64/ak07_c4_f2.vcraft had unexpected size. Mode 2 expected 3728256 actual 3228113.0 warnings.warn('VCRAFT file {} had unexpected size. Mode {} expected {} actual {}'.format(self.fname, self.mode, self.expected_nsamp, self.nsamps)) /fred/oz002/askap/craft/craco/craft-python/vcraft.py:110: UserWarning: VCRAFT file /fred/oz002/askap/craft/craco/processing/data/210407/frb/ak07/beam64/ak07_c4_f3.vcraft had unexpected size. Mode 2 expected 3728256 actual 3225042.5 warnings.warn('VCRAFT file {} had unexpected size. Mode {} expected {} actual {}'.format(self.fname, self.mode, self.expected_nsamp, self.nsamps)) /fred/oz002/askap/craft/craco/craft-python/vcraft.py:110: UserWarning: VCRAFT file /fred/oz002/askap/craft/craco/processing/data/210407/frb/ak07/beam64/ak07_c4_f4.vcraft had unexpected size. Mode 2 expected 3728256 actual 3226066.0

(...) _FRAMEID: 14791438089, remainder from 32: 9 samp_start + nsamp <= self.nsamps 12416 + 3675776 <= 3225042.5 beamforming: 0.08885281020775437 done Traceback (most recent call last): File "/fred/oz002/askap/craft/craco/CELEBI/craco_postproc/pipelines/../beamform//craftcor_tab.py", line 724, in _main() File "/fred/oz002/askap/craft/craco/CELEBI/craco_postproc/pipelines/../beamform//craftcor_tab.py", line 70, in _main temp = corr.do_tab(values.an) File "/fred/oz002/askap/craft/craco/CELEBI/craco_postproc/pipelines/../beamform//craftcor_tab.py", line 443, in do_tab temp = ant.do_f_tab(self, iant) File "/fred/oz002/askap/craft/craco/CELEBI/craco_postproc/pipelines/../beamform//craftcor_tab.py", line 140, in do_f_tab rawd = self.vfile.read(sampoff, nsamp) File "/fred/oz002/askap/craft/craco/craft-python/vcraft.py", line 413, in read assert samp_start + nsamp <= self.nsamps, 'Invalid read request. nsamp={} samp_start ={} differnce{}'.format(nsamp, samp_start, nsamp-samp_start) AssertionError: Invalid read request. nsamp=3675776 sampstart =12416 differnce3663360

Some of card 4 was identified to be an issue. See /fred/oz002/askap/craft/frb210407/frb/rawdata/SB25853/20210407110134/ICS/C000/ak07/beam64: beam64$ ll *t

Potentially requires using a subset of cards e.g. 1-3.

marcinglowacki commented 1 year ago

To be investigated when we get to this stage again (i.e. beamforming) for this frb.