New error while configuring antennas

[savinshynu]

pipeline1_dts - Advancing lane 5 by 2 steps pipeline1_dts - Advancing lane 6 by 2 steps pipeline1_dts - Advancing lane 7 by 2 steps pipeline1_dts - Advancing lane 8 by 4 steps pipeline1_dts - Advancing lane 9 by 2 steps pipeline1_dts - Advancing lane 10 by 2 steps pipeline1_dts - Advancing lane 11 by 2 steps pipeline1_dts - Automatic lane syncing failed! Traceback (most recent call last): File "/home/cosmic/anaconda3/envs/cosmic_vla/lib/python3.6/site-packages/cosmic/fengines/configure.py", line 138, in configure_antennaArrayStreams sync_offset_ns=antenna_fiberdelay_map[antname], File "", line 25, in cold_start File "/home/cosmic/anaconda3/envs/cosmic_vla/lib/python3.6/site-packages/remoteobjects/client/rest_client.py", line 46, in _post return self._manage_CRUD_request(requests.post, endpoint, data, params, files) File "/home/cosmic/anaconda3/envs/cosmic_vla/lib/python3.6/site-packages/remoteobjects/client/remote_instance.py", line 48, in _manage_CRUD_request request_func, endpoint, data=data, params=params, files=files File "/home/cosmic/anaconda3/envs/cosmic_vla/lib/python3.6/site-packages/remoteobjects/client/remote_object.py", line 82, in _manage_CRUD_request raise RuntimeError(resp_json["error"]) RuntimeError: <class 'RuntimeError'>: RuntimeError("Path /tmp/2022-07-26_14h29m00_adm_pcie_9h7_dts_dual_4x100g_dsp_8b_2022-05-19_1816.fpg doesn't exist")

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "configure_remotefpga.py", line 129, in ant_packconf_map, File "/home/cosmic/anaconda3/envs/cosmic_vla/lib/python3.6/site-packages/cosmic/fengines/configure.py", line 144, in configure_antennaArrayStreams f"Error {repr(err)} after trying to recover from {repr(previous_err)}." RuntimeError: Error RuntimeError('<class \'RuntimeError\'>: RuntimeError("Path /tmp/2022-07-26_14h29m00_adm_pcie_9h7_dts_dual_4x100g_dsp_8b_2022-05-19_1816.fpg doesn\'t exist")',) after trying to recover from RuntimeError("<class 'RuntimeError'>: RuntimeError('No sync pulse was detected over 0.5 seconds.')",).

[radonnachie]

The original command-line call would possibly help. A -p should copy the file over anew.... Looking at the time stamp of the /tmp/ file, it seems that the file was copied over freshly, so -p is inferred to have been present...

Ah.. The actual error is the No sync pulse was detected... The antenna-fengine targeted would be useful.

[jack-h]

Could the error logging be made to include this info? Both physical host and pcie ID are available within the control classes (https://github.com/realtimeradio/vla-dev/commit/349e6187d233252a079592d843babe781988e070)

[radonnachie]

Best generic solution would be implemented in remoteobjects and would provide server-uri and endpoint. Which should also enable us to replicate with curl. I'll get on it.