search

tarasglek / chatcraft.org

Developer-oriented ChatGPT clone
https://chatcraft.org/
MIT License
147 stars 26 forks source link

Add support for local webgpu models #624

Open tarasglek opened 2 months ago

tarasglek commented 2 months ago

both whisper and small llms can be run in browser now

we should start from llms: https://x.com/fleetwood___/status/1785383912732311882

humphd commented 2 months ago

@rjwignar you had expressed interest in working on some lower-level stuff. This would be a chance to play with some of that, if you're interested.

rjwignar commented 2 months ago

I read the tweet and it looks interesting. I think I can get this done this month

humphd commented 2 months ago

Cool @rjwignar. I figured you might find this interesting.

tarasglek commented 1 month ago

See also https://github.com/abi/secret-llama

rjwignar commented 3 weeks ago

This is going to have to wait for the end of the June ☹️. Adding share_target support is taking longer than expected

humphd commented 3 weeks ago

Don't worry @rjwignar, we'll be here when you have time to continue! Open source is great because there isn't a deadline. Thanks for working on this.