Closed lgq-liao closed 1 year ago
Hello, the firs error is just a warning and it's expected in some cases, if the second error happens with all the files not just this one let me know
@MahmoudAshraf97 I had tried to isolate the issue to see whether it's specific input audio issue. And I random downloaded 3 more test samples(Bed002-004) from ICSI corpus, only Bed004 pass the script.
msdd_model.diarize()
torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 1.14 GiB
(GPU 0; 7.79 GiB total capacity; 6.78 GiB already allocated; 689.44 MiB free; 6.80 GiB reserved in total by PyTorch)
If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation.
See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF
Any idea about the memory usage ?
result_aligned = whisperx.align()
result_aligned = whisperx.align(
File "/home/coe4-ws/anaconda3/lib/python3.8/site-packages/whisperx/alignment.py", line 302, in align
char_segments_arr = per_seg_grp.apply(lambda x: x.reset_index(drop = True)).reset_index()
File "/home/coe4-ws/anaconda3/lib/python3.8/site-packages/pandas/core/frame.py", line 6209, in reset_index
new_obj.insert(
File "/home/coe4-ws/anaconda3/lib/python3.8/site-packages/pandas/core/frame.py", line 4772, in insert
raise ValueError(f"cannot insert {column}, already exists")
ValueError: cannot insert subsegment-idx, already exists
the issue has solved by decreasing chunk_size on /home/user/.local/lib/python3.10/site-packages/deepmultilingualpunctuation/punctuationmodel.py
line 29
def predict(self,words):
overlap = 5
chunk_size = 100 # original value 230
if len(words) <= chunk_size:
overlap = 0
if you encounter after decreasing value, decrease more chunk_size 100 -> 80 -> 60
@cateyelow , yes, it works , thanks for the fix
I got this error from running the "Realligning Speech segments using Punctuation" section from the colab file. How do I change chunk sizes there?
Hello @MahmoudAshraf97
Thanks for the awesome sharing. I had tried your solution, everything looks great. There was only a chunk size too large issue encountered when I used the test sample icsi_corpus.wav
When I run your original script with the test sample above, the first error encountered at .
The second time the script broke and exited at
For the full log, please refer to the chunk_size_too_large.txt