Something wrong about GSS realignment from ASR-model

[ft-speech]

Hello, When i run activity_alignment.py(Generate finetuned time annotations from kaldi worn alignments), there is something wrong ，The following information is an error message：

Warning: Could not find P08_S02-0883960-0884024 in non_sil_alignment. Warning: Could not find P08_S02-0887758-0888024 in non_sil_alignment. Warning: Could not find P08_S02-0887758-0888024 in non_sil_alignment. Warning: Could not find P08_S02-0887758-0888024 in non_sil_alignment. Warning: Could not find P08_S02-0887758-0888024 in non_sil_alignment. Warning: Could not find P08_S02-0887758-0888024 in non_sil_alignment. Warning: Could not find P08_S02-0887758-0888024 in non_sil_alignment. Warning: Could not find P08_S02-0889164-0889316 in non_sil_alignment. Warning: Could not find P08_S02-0889164-0889316 in non_sil_alignment. Warning: Could not find P08_S02-0889164-0889316 in non_sil_alignment. Warning: Could not find P08_S02-0889164-0889316 in non_sil_alignment. Warning: Could not find P08_S02-0889164-0889316 in non_sil_alignment. Warning: Could not find P08_S02-0889164-0889316 in non_sil_alignment. Traceback (most recent call last): File "activity_alignment.py", line 198, in use_ArrayIntervall=True, File "/kaldi/egs/chime6/pb_chime5/pb_chime5/activity.py", line 214, in get_activity f'Something went wrong.\n' RuntimeError: Something went wrong. Expected 22932 times a finetuned annotation for session S02, but 22932 times they are missing. Expect that at least 1911 finetuned annotations are available, when non_sil_alignment_fn is given. Otherwise assume something went wrong.

Thanks a lot if you can answer how to avoid this mistake

[jensheit]

Hi, it looks like you are trying to run the activity_alignment.py file. This is not recommended since the __main__ function uses a hard-coded path to our kaldi environment. You can use the __main__ function to get an idea how to use the get_non_sil_alignment_fn_from_kalid function that is provided in this file.

Of course you have to setup a kaldi environment and calculate the alignments in Kaldi if you want to use this function.

Hope this helps

[ft-speech]

Hi, it looks like you are trying to run the activity_alignment.py file. This is not recommended since the __main__ function uses a hard-coded path to our kaldi environment. You can use the __main__ function to get an idea how to use the get_non_sil_alignment_fn_from_kalid function that is provided in this file.

Of course you have to setup a kaldi environment and calculate the alignments in Kaldi if you want to use this function.

Hope this helps

Thank you very much for your answer. I have solved this problem, but I have another problem ：

ERROR - Chime5 Array Enhancement - Failed after 1 day, 10:27:41! Traceback (most recent calls WITHOUT Sacred internals): File "/kaldi/egs/chime6/pb_chime5/pb_chime5/scripts/run.py", line 91, in main run(_run) File "/kaldi/egs/chime6/pb_chime5/pb_chime5/scripts/run.py", line 128, in run audio_dir_exist_ok=True File "/kaldi/egs/chime6/pb_chime5/pb_chime5/core_chime6.py", line 381, in enhance_session x_hat = self.enhance_example(ex) File "/kaldi/egs/chime6/pb_chime5/pb_chime5/core_chime6.py", line 495, in enhance_example debug=debug, File "/kaldi/egs/chime6/pb_chime5/pb_chime5/core_chime6.py", line 533, in enhance_observation masks = self.gss_block(Obs, acitivity_freq, debug=debug) File "/kaldi/egs/chime6/pb_chime5/pb_chime5/core_chime6.py", line 183, in call source_activity_mask=source_active_mask[f, ..., :T], File "/kaldi/egs/chime6/pb_chime5/pb_chime5/pb_bss/pb_bss/distribution/cacgmm.py", line 223, in fit initialization.shape, affiliation_shape AssertionError: ((5, 1140), (5, 1165))

Do you know what I should do to solve this problem