search

thewh1teagle / vibe

Transcribe on your own!
https://thewh1teagle.github.io/vibe/
MIT License
818 stars 54 forks source link

[Bug]: Vibe Crashes after clicking "transcribe" #268

Open zorero opened 1 week ago

zorero commented 1 week ago

What happened?

after selecting Audio file and clicking transcribe he app crashes. i tried with different audio files

Steps to reproduce

1) open Vibe 2) select file 3) click transcribe

What OS are you seeing the problem on?

Window

Relevant log output

Y:\>2024-09-09T05:21:27.175201Z DEBUG vibe::setup: Vibe App Running
2024-09-09T05:21:27.175607Z DEBUG vibe::setup: webview version: 128.0.2739.67
2024-09-09T05:21:27.175752Z DEBUG vibe::custom_protocol: Protocol handler registered successfully.
2024-09-09T05:21:27.175811Z DEBUG vibe::setup: Cargo features: vulkan
2024-09-09T05:21:27.175872Z DEBUG vibe::setup: CPU Features
{"avx":{"enabled":true,"support":true},"avx2":{"enabled":true,"support":true},"f16c":{"enabled":true,"support":true},"fma":{"enabled":true,"support":true}}
2024-09-09T05:21:27.175930Z DEBUG vibe::setup: Executable Architecture: x86_64
2024-09-09T05:21:27.175978Z DEBUG vibe::setup: APP VERSION: 2.5.1
2024-09-09T05:21:27.176024Z DEBUG vibe::setup: COMMIT HASH: bfa7a94b0fa46a50caa6f6a92a27ecb6de06b4bb
2024-09-09T05:21:27.176075Z DEBUG vibe::setup: Non CLI mode
2024-09-09T05:21:27.770814Z DEBUG vibe::cmd: models folder None
2024-09-09T05:21:27.778859Z DEBUG vibe::cmd::audio: Default Input Device:
Ok("Microphone (2- GENERAL WEBCAM)")
2024-09-09T05:21:27.778986Z DEBUG vibe::cmd::audio: Default Output Device:
Ok("Speaker (Realtek(R) Audio)")
2024-09-09T05:21:27.780471Z DEBUG vibe::cmd::audio: Devices:
2024-09-09T05:21:31.940089Z DEBUG vibe::cmd: loading model first time
2024-09-09T05:21:31.940252Z DEBUG vibe_core::transcribe: open model...
2024-09-09T05:21:31.940390Z DEBUG vibe_core::transcribe: gpu device: 1
2024-09-09T05:21:31.940502Z DEBUG vibe_core::transcribe: use gpu: true
2024-09-09T05:21:31.940599Z DEBUG vibe_core::transcribe: creating whisper context with model path C:\Users\user\AppData\Local\github.com.thewh1teagle.vibe\ggml-medium.bin
2024-09-09T05:21:31.941178Z  INFO whisper_rs::whisper_sys_tracing: whisper_init_from_file_with_params_no_state: loading model from 'C:\Users\user\AppData\Local\github.com.thewh1teagle.vibe\ggml-medium.bin'
2024-09-09T05:21:31.941741Z  INFO whisper_rs::whisper_sys_tracing: whisper_init_with_params_no_state: use gpu    = 1
2024-09-09T05:21:31.941983Z  INFO whisper_rs::whisper_sys_tracing: whisper_init_with_params_no_state: flash attn = 0
2024-09-09T05:21:31.942367Z  INFO whisper_rs::whisper_sys_tracing: whisper_init_with_params_no_state: gpu_device = 1
2024-09-09T05:21:31.942740Z  INFO whisper_rs::whisper_sys_tracing: whisper_init_with_params_no_state: dtw        = 0
2024-09-09T05:21:31.943384Z  INFO whisper_rs::whisper_sys_tracing: whisper_model_load: loading model
2024-09-09T05:21:31.943761Z  INFO whisper_rs::whisper_sys_tracing: whisper_model_load: n_vocab       = 51865
2024-09-09T05:21:31.943999Z  INFO whisper_rs::whisper_sys_tracing: whisper_model_load: n_audio_ctx   = 1500
2024-09-09T05:21:31.944531Z  INFO whisper_rs::whisper_sys_tracing: whisper_model_load: n_audio_state = 1024
2024-09-09T05:21:31.944898Z  INFO whisper_rs::whisper_sys_tracing: whisper_model_load: n_audio_head  = 16
2024-09-09T05:21:31.945238Z  INFO whisper_rs::whisper_sys_tracing: whisper_model_load: n_audio_layer = 24
2024-09-09T05:21:31.945583Z  INFO whisper_rs::whisper_sys_tracing: whisper_model_load: n_text_ctx    = 448
2024-09-09T05:21:31.945920Z  INFO whisper_rs::whisper_sys_tracing: whisper_model_load: n_text_state  = 1024
2024-09-09T05:21:31.946340Z  INFO whisper_rs::whisper_sys_tracing: whisper_model_load: n_text_head   = 16
2024-09-09T05:21:31.946679Z  INFO whisper_rs::whisper_sys_tracing: whisper_model_load: n_text_layer  = 24
2024-09-09T05:21:31.947012Z  INFO whisper_rs::whisper_sys_tracing: whisper_model_load: n_mels        = 80
2024-09-09T05:21:31.947323Z  INFO whisper_rs::whisper_sys_tracing: whisper_model_load: ftype         = 1
2024-09-09T05:21:31.948587Z  INFO whisper_rs::whisper_sys_tracing: whisper_model_load: qntvr         = 0
2024-09-09T05:21:31.948991Z  INFO whisper_rs::whisper_sys_tracing: whisper_model_load: type          = 4 (medium)
2024-09-09T05:21:31.998610Z  INFO whisper_rs::whisper_sys_tracing: whisper_model_load: adding 1608 extra tokens
2024-09-09T05:21:32.000006Z  INFO whisper_rs::whisper_sys_tracing: whisper_model_load: n_langs       = 99
ggml_vulkan: Found 1 Vulkan devices:
Vulkan0: NVIDIA GeForce GT 730 (NVIDIA) | uma: 0 | fp16: 0 | warp size: 32
ggml_vulkan: Device with index 9223377535176581249 does not exist.
fatal runtime error: Rust cannot catch foreign exceptions

also please find below log from Event Viewer

Faulting application name: vibe.exe, version: 2.5.1.0, time stamp: 0x66d0c897
Faulting module name: vibe.exe, version: 2.5.1.0, time stamp: 0x66d0c897
Exception code: 0xc0000409
Fault offset: 0x0000000000f5d46c
Faulting process id: 0x0x2004
Faulting application start time: 0x0x1DB0277D4562ECA
Faulting application path: C:\Users\user\AppData\Local\vibe\vibe.exe
Faulting module path: C:\Users\user\AppData\Local\vibe\vibe.exe
Report Id: 66ba4d8d-f8ca-406a-967c-6a232f762e32
Faulting package full name: 
Faulting package-relative application ID:
thewh1teagle commented 1 week ago

Hey @zorero Thanks for detailed report!

For some reason it cannot work for you with Vulkan. What GPU you have?

You can try earlier version of vibe that works slower but maybe it will solve the issue.

https://github.com/thewh1teagle/vibe/releases/tag/v2.4.0

zorero commented 1 week ago

Hi, Thanks for the prompt response @thewh1teagle. indeed older versions worked for me, i think the issue started on version 2.5.0 and i thought updating to 2.5.1 will solve it.

regrading my GPU NVIDIA GeForce GT 730

zorero commented 1 week ago

just to inform you (don't know if it helps you to understand the source of the issue) i installed version 2.4.0 it works.

thewh1teagle commented 1 week ago

just to inform you (don't know if it helps you to understand the source of the issue) i installed version 2.4.0 it works.

Thanks for letting know. I now noticed that the GPU option in your 2.5.0 is set to 1. did you changed it in the settings at the bottom from 0?

zorero commented 1 week ago

i might played with it, but i think i returned it to 0 i also did Restart of the app so it downloaded the module again. i will try now again (without changing GPU)

zorero commented 1 week ago

2024-09-10T12:17:27.527693Z DEBUG vibe::setup: Vibe App Running 2024-09-10T12:17:27.528049Z DEBUG vibe::setup: webview version: 128.0.2739.67 2024-09-10T12:17:27.528199Z DEBUG vibe::custom_protocol: Protocol handler registered successfully. 2024-09-10T12:17:27.528260Z DEBUG vibe::setup: Cargo features: vulkan 2024-09-10T12:17:27.528322Z DEBUG vibe::setup: CPU Features {"avx":{"enabled":true,"support":true},"avx2":{"enabled":true,"support":true},"f16c":{"enabled":true,"support":true},"fma":{"enabled":true,"support":true}} 2024-09-10T12:17:27.528383Z DEBUG vibe::setup: Executable Architecture: x86_64 2024-09-10T12:17:27.528434Z DEBUG vibe::setup: APP VERSION: 2.5.2 2024-09-10T12:17:27.528482Z DEBUG vibe::setup: COMMIT HASH: 7780d6fa971ef096a21e4ec84dc3330172f8a241 2024-09-10T12:17:27.528535Z DEBUG vibe::setup: Non CLI mode 2024-09-10T12:17:28.131114Z DEBUG vibe::cmd: models folder None 2024-09-10T12:17:28.137476Z DEBUG vibe::cmd::audio: Default Input Device: Ok("Microphone (2- GENERAL WEBCAM)") 2024-09-10T12:17:28.137690Z DEBUG vibe::cmd::audio: Default Output Device: Ok("Speaker (Realtek(R) Audio)") 2024-09-10T12:17:28.139170Z DEBUG vibe::cmd::audio: Devices: 2024-09-10T12:17:32.097334Z DEBUG vibe::cmd: loading model first time 2024-09-10T12:17:32.097488Z DEBUG vibe_core::transcribe: open model... 2024-09-10T12:17:32.097629Z DEBUG vibe_core::transcribe: gpu device: 0 2024-09-10T12:17:32.097750Z DEBUG vibe_core::transcribe: use gpu: true 2024-09-10T12:17:32.097967Z DEBUG vibe_core::transcribe: creating whisper context with model path C:\Users\user\AppData\Local\github.com.thewh1teagle.vibe\ggml-medium.bin 2024-09-10T12:17:32.098253Z INFO whisper_rs::whisper_sys_tracing: whisper_init_from_file_with_params_no_state: loading model from 'C:\Users\user\AppData\Local\github.com.thewh1teagle.vibe\ggml-medium.bin' 2024-09-10T12:17:32.098783Z INFO whisper_rs::whisper_sys_tracing: whisper_init_with_params_no_state: use gpu = 1 2024-09-10T12:17:32.098868Z INFO whisper_rs::whisper_sys_tracing: whisper_init_with_params_no_state: flash attn = 0 2024-09-10T12:17:32.099160Z INFO whisper_rs::whisper_sys_tracing: whisper_init_with_params_no_state: gpu_device = 0 2024-09-10T12:17:32.099404Z INFO whisper_rs::whisper_sys_tracing: whisper_init_with_params_no_state: dtw = 0 2024-09-10T12:17:32.099819Z INFO whisper_rs::whisper_sys_tracing: whisper_model_load: loading model 2024-09-10T12:17:32.100308Z INFO whisper_rs::whisper_sys_tracing: whisper_model_load: n_vocab = 51865 2024-09-10T12:17:32.100481Z INFO whisper_rs::whisper_sys_tracing: whisper_model_load: n_audio_ctx = 1500 2024-09-10T12:17:32.100798Z INFO whisper_rs::whisper_sys_tracing: whisper_model_load: n_audio_state = 1024 2024-09-10T12:17:32.101050Z INFO whisper_rs::whisper_sys_tracing: whisper_model_load: n_audio_head = 16 2024-09-10T12:17:32.101299Z INFO whisper_rs::whisper_sys_tracing: whisper_model_load: n_audio_layer = 24 2024-09-10T12:17:32.101541Z INFO whisper_rs::whisper_sys_tracing: whisper_model_load: n_text_ctx = 448 2024-09-10T12:17:32.101782Z INFO whisper_rs::whisper_sys_tracing: whisper_model_load: n_text_state = 1024 2024-09-10T12:17:32.102016Z INFO whisper_rs::whisper_sys_tracing: whisper_model_load: n_text_head = 16 2024-09-10T12:17:32.102255Z INFO whisper_rs::whisper_sys_tracing: whisper_model_load: n_text_layer = 24 2024-09-10T12:17:32.102507Z INFO whisper_rs::whisper_sys_tracing: whisper_model_load: n_mels = 80 2024-09-10T12:17:32.102755Z INFO whisper_rs::whisper_sys_tracing: whisper_model_load: ftype = 1 2024-09-10T12:17:32.103212Z INFO whisper_rs::whisper_sys_tracing: whisper_model_load: qntvr = 0 2024-09-10T12:17:32.103430Z INFO whisper_rs::whisper_sys_tracing: whisper_model_load: type = 4 (medium) 2024-09-10T12:17:32.150762Z INFO whisper_rs::whisper_sys_tracing: whisper_model_load: adding 1608 extra tokens 2024-09-10T12:17:32.152450Z INFO whisper_rs::whisper_sys_tracing: whisper_model_load: n_langs = 99 ggml_vulkan: Found 1 Vulkan devices: Vulkan0: NVIDIA GeForce GT 730 (NVIDIA) | uma: 0 | fp16: 0 | warp size: 32 2024-09-10T12:17:32.421412Z INFO whisper_rs::whisper_sys_tracing: whisper_model_load: NVIDIA GeForce GT 730 total size = 1533.14 MB 2024-09-10T12:17:34.264657Z INFO whisper_rs::whisper_sys_tracing: whisper_model_load: model size = 1533.14 MB 2024-09-10T12:17:34.271825Z DEBUG vibe_core::transcribe: created context successfuly 2024-09-10T12:17:34.274840Z DEBUG vibe_core::transcribe: Transcribe called with { "path": "C:\Users\user\Desktop\2.22.23_comp.mp3", "lang": "auto", "verbose": false, "n_threads": 4, "init_prompt": "", "temperature": 0.4, "translate": null, "max_text_ctx": null, "word_timestamps": false, "max_sentence_len": 1 } 2024-09-10T12:17:34.275140Z DEBUG vibe_core::transcribe: normalize "C:\Users\user\Desktop\2.22.23_comp.mp3"2024-09-10T12:17:34.276536Z DEBUG vibe_core::audio: ffmpeg path is C:\Users\user\AppData\Local\vibe\ffmpeg.exe 2024-09-10T12:18:11.260237Z DEBUG vibe::cmd: models folder None 2024-09-10T12:18:23.309238Z DEBUG vibe::cmd: models folder None 2024-09-10T12:18:26.611917Z DEBUG vibe::cmd: models folder None 2024-09-10T12:19:01.089772Z DEBUG vibe_core::transcribe: out path is C:\Users\user\AppData\Local\Temp.tmpN4gILP.wav 2024-09-10T12:19:01.090002Z DEBUG vibe_core::audio: wav reader read from "C:\Users\user\AppData\Local\Temp\.tmpN4gILP.wav" 2024-09-10T12:19:01.098565Z DEBUG vibe_core::audio: parsing C:\Users\user\AppData\Local\Temp.tmpN4gILP.wav 2024-09-10T12:19:01.461068Z INFO whisper_rs::whisper_sys_tracing: whisper_backend_init_gpu: using Vulkan backend 2024-09-10T12:19:01.624691Z INFO whisper_rs::whisper_sys_tracing: whisper_init_state: kv self size = 150.99 MB 2024-09-10T12:19:02.533084Z INFO whisper_rs::whisper_sys_tracing: whisper_init_state: kv cross size = 150.99 MB 2024-09-10T12:19:02.578008Z INFO whisper_rs::whisper_sys_tracing: whisper_init_state: kv pad size = 6.29 MB ggml_gallocr_needs_realloc: graph has different number of nodes ggml_gallocr_alloc_graph: cannot reallocate multi buffer graph automatically, call reserve ggml_backend_sched_alloc_splits: failed to allocate graph, reserving (backend_ids_changed = 0) ggml_gallocr_reserve_n: reallocating NVIDIA GeForce GT 730 buffer from size 0.00 MiB to 25.73 MiB ggml_gallocr_reserve_n: reallocating CPU buffer from size 0.00 MiB to 0.00 MiB 2024-09-10T12:19:02.579571Z INFO whisper_rs::whisper_sys_tracing: whisper_init_state: compute buffer (conv) = 28.55 MB ggml_gallocr_needs_realloc: graph has different number of nodes ggml_gallocr_alloc_graph: cannot reallocate multi buffer graph automatically, call reserve ggml_backend_sched_alloc_splits: failed to allocate graph, reserving (backend_ids_changed = 0) ggml_gallocr_reserve_n: reallocating NVIDIA GeForce GT 730 buffer from size 0.00 MiB to 565.06 MiB ggml_vulkan: Device memory allocation of size 592512000 failed. ggml_vulkan: vk::Device::allocateMemory: ErrorOutOfDeviceMemory ggml_gallocr_reserve_n: failed to allocate NVIDIA GeForce GT 730 buffer of size 592512000