search

alexanderatallah / window.ai

Use your own AI models on the web
https://windowai.io
MIT License
782 stars 68 forks source link

Support for @xenova/transformers seq2seq pipelines and webLLM #80

Open MiguelsPizza opened 1 week ago

MiguelsPizza commented 1 week ago

The transformers.js api would provide a better UX for downloading and running local models. Inference could be done in the extension service worker which now supports webGPU