xenova / transformers.js

State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!
https://huggingface.co/docs/transformers.js
Apache License 2.0
9.71k stars 571 forks source link

[v3] webgpu-chat demo fails with `no available backend found` #775

Open rjcorwin opened 1 month ago

rjcorwin commented 1 month ago

System Info

macOS M1 Monterey

Environment/Platform

Description

This is a repost of https://github.com/xenova/transformers.js/issues/764

Using the repository from : https://github.com/xenova/transformers.js/tree/v3/examples/webgpu-chat and "@xenova/transformers": "github:xenova/transformers.js#v3", it gets stuck on loading model with error in chrome console:

@xenova_transformers.js?v=ef40148f:1386 Uncaught (in promise) Error: no available backend found. ERR: [webgpu] TypeError: Failed to fetch dynamically

@xenova, I've verified that the branch I checked out last night has the two commits you mention here. Thanks for your continued support of this project!!

Reproduction

  1. Clone repo from https://github.com/xenova/transformers.js/tree/v3/examples/webgpu-chat
  2. npm i and do npm run dev;
  3. Go to url
  4. Load Model
  5. Model gets stuck on ...loading...
flatsiedatsie commented 4 weeks ago

Seeing something similar, but only sometimes.

Screenshot 2024-05-29 at 15 00 58