search

huggingface / transformers.js

State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!
https://huggingface.co/docs/transformers.js
Apache License 2.0
11.36k stars 708 forks source link

I would like to help #973

Open cyberluke opened 5 days ago

cyberluke commented 5 days ago

Question

Hi, I would like to help with the project. Is there anything that needs to be done?

Currently I found an issue, probably in ONNXRuntime. I will look into it next week.

Here is example of WebGPU Whisper that works with mobile platforms including iPhone and Android: https://github.com/FL33TW00D/whisper-turbo

Current Transformers.js solution have some bugs. It will crash after model loading, page will restart on mobile device. I tried to connect remote debugging to Chrome PC via some ios remote debugging bridge, but it just restarts and I cannot get any logs. Any help how to get logs would be appreciated as I don't have much experience with iOS Safari debugging and I also happen to have Windows PC.

Here is photo from Safari - iPhone, you can see it does not support float32, but only float16. I suspect this is the issue and there are like 3 separate pull requests in ONNX to fix something around float16 support. But I did not have time to merge all current ONNX PRs and build it yet. First I would like to see some log with actual error webgpu

This is what I will be working on next weekend.

If there is something else I should look into or help with testing, let me know.

Thank you for great project and great work! :-)

flatsiedatsie commented 3 days ago

but it just restarts and I cannot get any logs.

Check the 'preserve log' box:

Screenshot 2024-10-14 at 21 37 15