A numeric error is thrown by pipeline during text-generation model loading

[DawitJung]

System Info

1. Apple M2 Pro
2. mac OS Sequoia v15.0.1
3. Google Chrome v130.0.6723.116
4. @huggingface/transformers v3.0.2

Environment/Platform

• [X] Website/web-app
• [ ] Browser extension
• [ ] Server-side (e.g., Node.js, Deno, Bun)
• [ ] Desktop app (e.g., Electron)
• [ ] Other (e.g., VSCode extension)

Description

I'm encountering an issue while trying to load a text-generation model using the pipeline function. My code searches for models on Hugging Face by keyword, filters for "text-generation", "transformers.js", and "onnx" tags, and attempts to load the resulting models. When I attempt to load certain models, an error with a numeric code (e.g., 3330359752) is thrown. The numeric code changes each time, suggesting it may not hold specific meaning.

Notably, it seems that smaller models load successfully, while larger models may consistently throw this error, though I’m not entirely certain.

Models that loaded successfully:

• onnx-community/Llama-3.2-1B-Instruct-q4f16
• onnx-community/AMD-OLMo-1B-SFT-DPO

Models that failed to load:

• onnx-community/Llama-3.2-1B-Instruct
• onnx-community/Llama-3.2-3B-Instruct
• Xenova/Phi-3-mini-4k-instruct

Reproduction

generator = await pipeline(
    "text-generation",
    "onnx-community/Llama-3.2-3B-Instruct",
    { device: "webgpu" }
  );

[xenova]

While this might be an out-of-memory issues, the models have been tested and work in Node.js, so maybe a runtime error occurring for WebGPU. cc @guschmue