Chrome on Android crashes when starting Whisper

[flatsiedatsie]

System Info

While it runs fine on desktop, it crashes on mobile.

Pixel 6A Android 14 (6gb ram)

Using Transformers.js V2 (the website is a mix of V2 and V3, but with this test no V3 things (e.g. musicgen) have loaded, running Whisper in a webworker.

The webworker is based on the AutomaticSpeechRecognitionPipelineFactory example.

The model being loaded is Xenova/whisper-base.en. Right before the crash I see the serviceworker confirm that it was downloaded and caching it.

Environment/Platform

• [X] Website/web-app
• [ ] Browser extension
• [ ] Server-side (e.g., Node.js, Deno, Bun)
• [ ] Desktop app (e.g., Electron)
• [ ] Other (e.g., VSCode extension)

Description

Chrome on Android crashed with an "Aw snap" screen. This happens consistently every time.

I managed to connect remote debugging and saw this:

Some code from the worker:

let data = transcriber.tokenizer._decode_asr(chunks_to_process, {
    time_precision: time_precision,
    return_timestamps: true,
    force_full_sequences: false,
});

and

output = await transcriber(audio, {
     // Greedy
      top_k: 0,
     do_sample: false,

     / Sliding window
     chunk_length_s: isDistilWhisper ? 20 : 30,
     stride_length_s: isDistilWhisper ? 3 : 5,

     // Language and task
     language: language,
     task: subtask,

     // Return timestamps
     return_timestamps: true,
     orce_full_sequences: false,

     // Callback functions
     callback_function: callback_function, // after each generation step
     chunk_callback: chunk_callback, // after each chunk is processed
})

Reproduction

I will email you a link so you can try it yourself.

I will also try to create a lower resource version and see if I can find out more.

[flatsiedatsie]

I tested the official whisper example with the same settings, and get the same result. It must be a memory issue, as running the example on the phone withtiny and quant enabled does work.

[flatsiedatsie]

Hmm, still getting errors, even when using tiny+quantization:

[flatsiedatsie]

Funny, when searching for the error code the first result is for Transformers.js, and whisper.

https://github.com/xenova/transformers.js/issues/54