Open IzzyHibbert opened 1 month ago
Didn't download the mp3 file. Is the link correct?
Didn't download the mp3 file. Is the link correct?
Yes, works. Even a copy+paste in browser works for me.
Sometimes there is a problem while downloading. That's why you have to try again and again.
Sometimes there is a problem while downloading. That's why you have to try again and again.
No I had my file downloaded. The error occurs after, you can see that it fails in the speakers line
whisper_diarize.py
line 171
Also, I made another video to work, using CPU, same machine (sonot an issue with the installation to me)
Can you give the path of the .mp3 file to the audio_pah variable? Because it cannot read the audio file. It returns to None.
Can you give the path of the .mp3 file to the audio_pah variable? Because it cannot read the audio file. It returns to None.
I will try early tomorrow and let you know, thanks
Ok, I founded out. It turned that the solution is not able to process the video (audio) I used :
https://www.youtube.com/watch?v=3p-VBQ4l-4s
I tried both with CUDA and CPU. Both KO. As soon as in the same installation I use another video (audio) it works fine.
My 2cents: the only possible cause I see for this case is a bug when the video (audio) includes few notes of a jingle at the beginning of the audio and no voices (which just come seconds after..
To my opinion this occurs when the code cannot produce a time stamp for the last element of "end_timestamps"
Also seeing this, and @risedangel seems to be correct:
Whisper did not predict an ending timestamp, which can happen if audio is cut off in the middle of a word. Also make sure WhisperTimeStampLogitsProcessor was used during generation.
Traceback (most recent call last):
File "/mnt/array1/home/guyep/playground/whisper-plus/diarize.py", line 18, in <module>
output_text = pipeline(audio_path, num_speakers=16)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/array1/home/guyep/miniconda3/envs/whisper-plus/lib/python3.12/site-packages/whisperplus/pipelines/whisper_diarize.py", line 171, in __call__
upto_idx = np.argmin(np.abs(end_timestamps - end_time))
~~~~~~~~~~~~~~~^~~~~~~~~~
TypeError: unsupported operand type(s) for -: 'NoneType' and 'float'
I am using:
WhisperPlus v0.3.0 Cuda 12.1 It throws the following error :
When I use this request (aligned with repo instructions)....
Any idea ?