Problem with GPU Metal Deallocation: ggml_metal_free

[JohnDiniz]

You can configure whisper.cpp to use only the CPU instead of the GPU, or is there any solution to avoid this GPU Metal deallocation error?

node sub.mjs Whisper already exists at /Users/joaovitordinizmistrinel/template-tiktok/whisper.cpp Model already exists at /Users/joaovitordinizmistrinel/template-tiktok/whisper.cpp/ggml-medium.en.bin Extracting audio from file sample-video.mp4 /Users/joaovitordinizmistrinel/template-tiktok/node_modules/@remotion/install-whisper-cpp/dist/transcribe.js:127 reject(new Error(Process was killed with signal ${exitSignal}: ${output})); ^

Error: Process was killed with signal SIGTERM: whisper_init_from_file_with_params_no_state: loading model from '/Users/joaovitordinizmistrinel/template-tiktok/whisper.cpp/ggml-medium.en.bin' whisper_model_load: loading model whisper_model_load: n_vocab = 51864 whisper_model_load: n_audio_ctx = 1500 whisper_model_load: n_audio_state = 1024 whisper_model_load: n_audio_head = 16 whisper_model_load: n_audio_layer = 24 whisper_model_load: n_text_ctx = 448 whisper_model_load: n_text_state = 1024 whisper_model_load: n_text_head = 16 whisper_model_load: n_text_layer = 24 whisper_model_load: n_mels = 80 whisper_model_load: ftype = 1 whisper_model_load: qntvr = 0 whisper_model_load: type = 4 (medium) whisper_model_load: adding 1607 extra tokens whisper_model_load: n_langs = 99 whisper_backend_init: using Metal backend ggml_metal_init: allocating ggml_metal_init: found device: AMD Radeon RX 570 ggml_metal_init: picking default device: AMD Radeon RX 570 ggml_metal_init: default.metallib not found, loading from source ggml_metal_init: GGML_METAL_PATH_RESOURCES = nil ggml_metal_init: loading '/Users/joaovitordinizmistrinel/template-tiktok/whisper.cpp/ggml-metal.metal' ggml_metal_init: GPU name: AMD Radeon RX 570 ggml_metal_init: GPU family: MTLGPUFamilyCommon3 (3003) ggml_metal_init: simdgroup reduction support = false ggml_metal_init: simdgroup matrix mul. support = false ggml_metal_init: hasUnifiedMemory = false ggml_metal_init: recommendedMaxWorkingSetSize = 4294.97 MB ggml_metal_init: skipping kernel_soft_max (not supported) ggml_metal_init: skipping kernel_soft_max_4 (not supported) ggml_metal_init: skipping kernel_rms_norm (not supported) ggml_metal_init: skipping kernel_group_norm (not supported) ggml_metal_init: skipping kernel_mul_mv_f32_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_f16_f16 (not supported) ggml_metal_init: skipping kernel_mul_mv_f16_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_f16_f32_1row (not supported) ggml_metal_init: skipping kernel_mul_mv_f16_f32_l4 (not supported) ggml_metal_init: skipping kernel_mul_mv_q4_0_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_q4_1_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_q5_0_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_q5_1_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_q8_0_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_q2_K_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_q3_K_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_q4_K_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_q5_K_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_q6_K_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_iq2_xxs_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_iq2_xs_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_iq3_xxs_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_iq3_s_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_iq2_s_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_iq1_s_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_iq1_m_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_iq4_nl_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_iq4_xs_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_id_f32_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_id_f16_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_id_q4_0_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_id_q4_1_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_id_q5_0_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_id_q5_1_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_id_q8_0_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_id_q2_K_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_id_q3_K_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_id_q4_K_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_id_q5_K_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_id_q6_K_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_id_iq2_xxs_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_id_iq2_xs_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_id_iq3_xxs_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_id_iq3_s_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_id_iq2_s_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_id_iq1_s_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_id_iq1_m_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_id_iq4_nl_f32 (not supported) ggml_metal_init: skipping kernel_mul_mv_id_iq4_xs_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_f32_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_f16_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_q4_0_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_q4_1_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_q5_0_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_q5_1_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_q8_0_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_q2_K_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_q3_K_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_q4_K_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_q5_K_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_q6_K_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_iq2_xxs_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_iq2_xs_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_iq3_xxs_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_iq3_s_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_iq2_s_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_iq1_s_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_iq1_m_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_iq4_nl_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_iq4_xs_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_id_f32_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_id_f16_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_id_q4_0_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_id_q4_1_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_id_q5_0_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_id_q5_1_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_id_q8_0_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_id_q2_K_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_id_q3_K_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_id_q4_K_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_id_q5_K_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_id_q6_K_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_id_iq2_xxs_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_id_iq2_xs_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_id_iq3_xxs_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_id_iq3_s_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_id_iq2_s_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_id_iq1_s_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_id_iq1_m_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_id_iq4_nl_f32 (not supported) ggml_metal_init: skipping kernel_mul_mm_id_iq4_xs_f32 (not supported) whisper_backend_init: Metal GPU does not support family 7 - falling back to CPU ggml_metal_free: deallocating

at ChildProcess.<anonymous> (/Users/joaovitordinizmistrinel/template-tiktok/node_modules/@remotion/install-whisper-cpp/dist/transcribe.js:127:24)
at ChildProcess.emit (node:events:520:28)
at ChildProcess._handle.onexit (node:internal/child_process:294:12)

Node.js v22.7.0

[JonnyBurger]

Is this an Intel Mac? I have no expertise unfortunately and can also not test - this issue would be better suited if you file it with whisper.cpp, after searching existing issues first

[JohnDiniz]

Is this an Intel Mac? I have no expertise unfortunately and can also not test - this issue would be better suited if you file it with whisper.cpp, after searching existing issues first

Yes, it's an Intel Mac.