cta-wave / device-observation-framework

This repository contains the WAVE Device Observation Framework. The DPCTF Device Observation Framework determines pass or fail results, based on observations taken of tests which are run on a device by the DPCTF Test Runner. DPCTF is the Device Playback Compatibility Task Force of the CTA WAVE Project (https://CTA.tech/WAVE and standards@CTA.tech for more info).
Other
1 stars 3 forks source link

OF exiting: list index out of range #47

Closed FritzHeiden closed 1 year ago

FritzHeiden commented 1 year ago

Some recordings I am analysing with the OF eventually result in the same error: IndexError: list index out of range

I will share a recording with you via email.

config.ini:

[GENERAL]
test_runner_url = <our_hosted_instance>
sort_input_files_by = filename
log_file_path = logs
result_file_path = results
session_log_threshold = 100
missing_frame_threshold = 0
consecutive_no_qr_threshold = 0
end_of_session_timeout = 10
no_qr_code_timeout = 5
search_qr_area_to = 60
qr_area_margin = 50
duplicated_qr_check_count = 3

[TOLERANCES]
start_frame_num_tolerance = 0
end_frame_num_tolerance = 0
mid_frame_num_tolerance = 10
splice_start_frame_num_tolerance = 0
splice_end_frame_num_tolerance = 0

Logs:

INFO     Start a New test: cfhd_12.5_25_50-local/sequential-track-playback__t10.html
ERROR    Serious error is detected, when analysing ['input.mp4']! list index out of range: Traceback (most recent call last):
  File "observation_framework.py", line 516, in main
    do_adaptive_threshold_scan,
  File "observation_framework.py", line 378, in run
    vidcap, starting_camera_frame_number, qr_code_areas
  File "/home/me/device-observation-framework/observation_framework_processor.py", line 636, in iter_qr_codes_in_video
    self._process_test_status_qr_code(new_test_status_qr_code)
  File "/home/me/device-observation-framework/observation_framework_processor.py", line 364, in _process_test_status_qr_code
    self._make_observations()
  File "/home/me/device-observation-framework/observation_framework_processor.py", line 287, in _make_observations
    self.time_diff_file,
  File "/home/me/device-observation-framework/test_code/sequential_track_playback.py", line 169, in make_observations
    frame_rate = mezzanine_qr_codes[-1].frame_rate
IndexError: list index out of range
Traceback (most recent call last):
  File "observation_framework.py", line 516, in main
    do_adaptive_threshold_scan,
  File "observation_framework.py", line 378, in run
    vidcap, starting_camera_frame_number, qr_code_areas
  File "/home/me/device-observation-framework/observation_framework_processor.py", line 636, in iter_qr_codes_in_video
    self._process_test_status_qr_code(new_test_status_qr_code)
  File "/home/me/device-observation-framework/observation_framework_processor.py", line 364, in _process_test_status_qr_code
    self._make_observations()
  File "/home/me/device-observation-framework/observation_framework_processor.py", line 287, in _make_observations
    self.time_diff_file,
  File "/home/me/device-observation-framework/test_code/sequential_track_playback.py", line 169, in make_observations
    frame_rate = mezzanine_qr_codes[-1].frame_rate
IndexError: list index out of range
INFO     Device Observation Framework has finished analysing all selected recordings, Device Observation Framework is exiting.
yanj-github commented 1 year ago

@FritzHeiden I cannot see same error for test cfhd_12.5_25_50-local/sequential-track-playback__t10.html

2023-07-27 14:10 observation_framework_processor INFO     Start a New test: cfhd_12.5_25_50-local/sequential-track-playback__t10.html
2023-07-27 14:26 observations.every_sample_rendered INFO     Making observation [OF] Every sample S[k,s] shall be rendered and the samples shall be rendered in increasing presentation time order....
2023-07-27 14:26 observations.duration_matches_cmaf_track INFO     Making observation [OF] The playback duration of the playback matches the duration of the CMAF Track, i.e. TR [k, S] = TR [k, 1] + td[k]....
2023-07-27 14:26 observations.start_up_delay INFO     Making observation [OF] The start-up delay should be sufficiently low, i.e., TR [k, 1] - Ti < TSMax....
2023-07-27 14:26 observations.sample_matches_current_time INFO     Making observation [OF] The presented sample matches the one reported by the currentTime value within the tolerance of the sample duration....
2023-07-27 14:29 __main__     INFO     Recorded file renamed to '/media/sf_Shared/observation_framework/trunk/recordings/output1_dpctf_9cf11e0a-1436-11ee-b958-0242ac110003.mp4'.
2023-07-27 14:29 __main__     INFO     Device Observation Framework analysis ended.
2023-07-27 14:29 __main__     INFO     Device Observation Framework has finished analysing all selected recordings, Device Observation Framework is exiting.

Can you double check the recording shared on email is the right one please?

yanj-github commented 1 year ago

I have commited fixes for this issue.

FritzHeiden commented 1 year ago

Thank you, I reran analysis on affected recordings and everything worked fine