chidiwilliams / buzz

Buzz transcribes and translates audio offline on your personal computer. Powered by OpenAI's Whisper.
https://chidiwilliams.github.io/buzz
MIT License
12.41k stars 938 forks source link

Major memory issues with sequential batched transcriptions (edit: memory leak issue?) #672

Closed ndillmanhasso closed 9 months ago

ndillmanhasso commented 9 months ago

Latest macOS App store update causes major memory issues when running multiple transcriptions. Got an error that too much memory was used on M2 Pro Macbook Pro (first time ever). Screenshot of activity monitor attached. I selected 20 video files to run SRT transcriptions on all of them; prior to this update I had no issues with batch transcriptions (not simultaneous but sequential). Screenshot 2024-01-20 at 4 00 50 PM

ndillmanhasso commented 9 months ago

Happens when batch transcribing with csv output as well and not using world-level timings. Here is more detailed info:

1) Video files stored locally on device but through cloud storage (OneDrive, but kept on device; tested when not in cloud storage and same issue happens) 2) Open buzz and click import, select "File..." and select all files in question (mp4 in this case) 3) Start transcription. I used the "Whisper.cpp - Large" model for all transcriptions as I have before with no issue. Language is English. Happened with word level timings on for SRT and off for CSV. Click "Run"

Happy to provide any more logs/testing/info if you need, just let me know.

Activity monitor for first transcription: Screenshot 2024-01-21 at 10 09 22 AM

Activity monitor for second transcription: Screenshot 2024-01-21 at 10 09 54 AM

Activity monitor for third transcription: Screenshot 2024-01-21 at 10 16 58 AM

Memory pressure increase from first to second transcription: Screenshot 2024-01-21 at 10 10 26 AM

chidiwilliams commented 9 months ago

Appreciate the detailed feedback. I'll take a look at this.

chidiwilliams commented 9 months ago

side note -- no way to click "cancel" on this screen without quitting Buzz that I've seen... You either have to click "Run" or force quit buzz through command + option + escape, command + q doesn't work either. I may be missing something though.

Just the "Escape" button here should close the dialog. I'll add a 'Cancel' button as well.

ndillmanhasso commented 9 months ago

Just the "Escape" button here should close the dialog. I'll add a 'Cancel' button as well.

whelp, I feel dumb for missing that... thanks for the tip!

chidiwilliams commented 9 months ago

This should be fixed now in the latest update. Thanks!