search

lofar-astron / factor

Facet calibration for LOFAR
http://www.astron.nl/citt/facet-doc
GNU General Public License v2.0
19 stars 12 forks source link

error in convert_solutions_to_gain #170

Closed rvweeren closed 7 years ago

rvweeren commented 7 years ago

I think "ERROR node.lofar.python_plugin: local variable 'total_amp' referenced before assignment" causes the crash (see below)

2016-12-12 21:11:09 INFO node.lofar.python_plugin: Processing /p3600/rvweeren/P214_52_full_preapply/results/facetselfcal/facet_patch_244/L343226_SBgr025-10_uv.dppp.pre-cal_chunk9_12656E813t_0g.merge_phase_parmdbs 2016-12-12 21:11:09 WARNING facetselfcal_facet_patch_244.executable_args: /home/rvweeren/software/lofaroct2016/opt/LofIm2/lib/python2.7/site-packages/lofar/parmdb/init.py:22: RuntimeWarning: to-Python converter for std::vector<double, std::allocator > already registered; second conversion method ignored. 2016-12-12 21:11:09 WARNING facetselfcal_facet_patch_244.executable_args: from _parmdb import ParmDB 2016-12-12 21:11:09 WARNING facetselfcal_facet_patch_244.executable_args: /home/rvweeren/software/lofaroct2016/opt/LofIm2/lib/python2.7/site-packages/lofar/parmdb/init.py:22: RuntimeWarning: to-Python converter for std::vector<std::string, std::allocator > already registered; second conversion method ignored. 2016-12-12 21:11:09 WARNING facetselfcal_facet_patch_244.executable_args: from _parmdb import ParmDB 2016-12-12 21:11:33 ERROR node.lofar.python_plugin: local variable 'total_amp' referenced before assignment 2016-12-12 21:11:33 INFO node.lofar.python_plugin: Total time 24.2743s; user time: 20.3082s; system time: 4.8109s 2016-12-12 21:11:33 DEBUG node.lofar.python_plugin: Start time was 1481595069.5423s; end time was 1481595093.8167s 2016-12-12 21:11:34 DEBUG facetselfcal_facet_patch_244.executable_args: Results for job 0 submitted by ('127.0.0.1', 49861) 2016-12-12 21:11:34 DEBUG facetselfcal_facet_patch_244.executable_args: 2016-12-12 21:11:34 WARNING facetselfcal_facet_patch_244.executable_args: 2016-12-12 21:11:34 INFO facetselfcal_facet_patch_244.executable_args: Subprocess completed with exit status 1: /bin/sh -c python /home/rvweeren/software/lofaroct2016/opt/LofIm2/lib/python2.7/site-packages/lofarpipe/recipes/nodes/python_plugin.py 0 127.0.1.1 53884 2016-12-12 21:11:34 ERROR facetselfcal_facet_patch_244.executable_args: Remote process python /home/rvweeren/software/lofaroct2016/opt/LofIm2/lib/python2.7/site-packages/lofarpipe/recipes/nodes/python_plugin.py ['/p3600/rvweeren/P214_52_full_preapply/results/facetselfcal/facet_patch_244/L343226_SBgr025-10_uv.dppp.pre-cal_chunk9_12656E813t_0g.merge_phase_parmdbs', '/usr/local/lib/python2.7/dist-packages/FACTOR-1.0-py2.7.egg/factor/scripts/convert_solutions_to_gain.py', ['/p3600/rvweeren/P214_52_full_preapply/results/facetselfcal/facet_patch_244/L343226_SBgr025-10_uv.dppp.pre-cal_chunk9_12656E813t_0g.merge_phase_parmdbs', '/p3600/rvweeren/P214_52_full_preapply/results/facetselfcal/facet_patch_244/L343226_SBgr025-10_uv.dppp.pre-cal_chunk9_12656E813t_0g.smooth_amp2', '/p3600/rvweeren/P214_52_full_preapply/results/facetselfcal/facet_patch_244/L343226_SBgr025-10_uv.dppp.pre-cal_chunk9_12656E813t_0g.convert_merged_selfcal_parmdbs', '20', '/p3600/rvweeren/P214_52_full_preapply/results/facetpeel/facet_patch_539/L343226_SBgr025-10_uv.dppp.pre-cal_chunk9_12656E813t_3g.create_preapply_parmdb'], {}, '/p3600/rvweeren/P214_52_full_preapply/results/facetselfcal/facet_patch_244', False, {'args_format_option_argument': '=', 'args_format_option': '-', 'args_format': 'gnu', 'args_formatlongoption': '--', 'args_format_argument': ''}, {'SHLIB_PATH': '/home/rvweeren/software/root/lib:', 'MANDATORY_PATH': '/usr/share/gconf/ubuntu.mandatory.path', 'XDG_SESSION_PATH': '/org/freedesktop/DisplayManager/Session0', 'DEFAULTS_PATH': '/usr/share/gconf/ubuntu.default.path', 'LOFARDATAROOT': '/opt/lofar/data', 'OMP_NUM_THREADS': '8', 'PYTHONPATH': '/home/rvweeren/software/lofaroct2016/opt/LofIm2/lib/python2.7/site-packages:/home/rvweeren/software/root/lib:/home/rvweeren/software/heasoft-6.16/x86_64-unknown-linux-gnu-libc2.19-0/lib/python:/home/rvweeren/software/heasoft-6.16/x86_64-unknown-linux-gnu-libc2.19-0/lib:/home/rvweeren/software/wcsaxes/build/lib/python/:/home/rvweeren/software/pyvo/build/lib/python/:/home/rvweeren/software/wcsaxes/build/lib/python/:/home/rvweeren/software/pyvo/build/lib/python/:/home/rvweeren/software/wcsaxes/build/lib/python/:/home/rvweeren/software/pyvo/build/lib/python/::/home/rvweeren/scripts/pp:/home/rvweeren/scripts/pp:/home/rvweeren/scripts/pp', 'COMPIZ_BIN_PATH': '/usr/bin/', 'LIBPATH': '/home/rvweeren/software/root/lib:', 'DYLD_LIBRARY_PATH': '/home/rvweeren/software/root/lib:', 'LOFARROOT': '/home/rvweeren/software/lofaroct2016/opt/LofIm2', 'MANPATH': '/home/rvweeren/software/root/man:/home/rvweeren/software/heasoft-6.16/x86_64-unknown-linux-gnu-libc2.19-0/man:/usr/local/man:/usr/local/share/man:/usr/share/man:/usr/lib/jvm/java-8-oracle/man', 'XDG_SEAT_PATH': '/org/freedesktop/DisplayManager/Seat0', 'PATH': '/home/rvweeren/software/lofaroct2016/opt/LofIm2/sbin:/home/rvweeren/software/lofaroct2016/opt/LofIm2/bin:/home/rvweeren/software/root/bin:/home/rvweeren/software/heasoft-6.16/x86_64-unknown-linux-gnu-libc2.19-0/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/usr/lib/jvm/java-8-oracle/bin:/usr/lib/jvm/java-8-oracle/db/bin:/usr/lib/jvm/java-8-oracle/jre/bin:/home/rvweeren/software/casapy/casa-release-4.5.2-el6:/home/rvweeren/software/wsclean-code/wsclean/build/:/home/rvweeren/software/ds9/:/home/rvweeren/software/UDR/src/:/home/rvweeren/software/losoto:/home/rvweeren/software/losoto/tools:/home/rvweeren/software/casapy/casa-release-4.5.2-el6:/home/rvweeren/software/wsclean-code/wsclean/build/:/home/rvweeren/software/ds9/:/home/rvweeren/software/UDR/src/:/home/rvweeren/software/losoto:/home/rvweeren/software/losoto/tools:/home/rvweeren/software/casapy/casa-release-4.5.2-el6:/home/rvweeren/software/wsclean-code/wsclean/build/:/home/rvweeren/software/ds9/:/home/rvweeren/software/UDR/src/:/home/rvweeren/software/losoto:/home/rvweeren/software/losoto/tools', 'LD_LIBRARY_PATH': '/home/rvweeren/software/lofaroct2016/opt/LofIm2/lib:4104LD_LIBRARY_PATH:/usr/local/lib'}] failed on localhost 2016-12-12 21:11:34 DEBUG facetselfcal_facet_patch_244.executable_args: compute.dispatch results job 0: job_duration: 25.2299969196, returncode: 1 2016-12-12 21:11:35 DEBUG facetselfcal_facet_patch_244.executable_args: Adding node_logging_information 2016-12-12 21:11:35 ERROR facetselfcal_facet_patch_244.executable_args: A job has failed with returncode 1 and error_tolerance is not set. Bailing out! 2016-12-12 21:11:35 WARNING facetselfcal_facet_patch_244.executable_args: Note: recipe outputs are not complete 2016-12-12 21:11:35 WARNING facetselfcal_facet_patch_244.executable_args: recipe executable_args completed with errors 2016-12-12 21:11:35 WARNING facetselfcal_facet_patch_244: convert_solutions_to_gain reports failure (using executable_args recipe) 2016-12-12 21:11:35 ERROR facetselfcal_facet_patch_244: 2016-12-12 21:11:35 ERROR facetselfcal_facet_patch_244: Failed pipeline run: facet_patch_244 2016-12-12 21:11:35 ERROR facetselfcal_facet_patch_244: Detailed exception information: 2016-12-12 21:11:35 ERROR facetselfcal_facet_patch_244: <class 'lofarpipe.support.lofarexceptions.PipelineRecipeFailed'> 2016-12-12 21:11:35 ERROR facetselfcal_facet_patch_244: convert_solutions_to_gain failed 2016-12-12 21:11:35 ERROR facetselfcal_facet_patch_244: 2016-12-12 21:11:35 ERROR facetselfcal_facet_patch_244: LOFAR Pipeline finished unsuccesfully. 2016-12-12 21:11:36 WARNING facetselfcal_facet_patch_244: recipe facetselfcal_facet_patch_244 completed with errors

darafferty commented 7 years ago

Should be fixed now. (It only appeared if you had preapply_first_cal_phases = True.)

rvweeren commented 7 years ago

Thanks.