search

cztomsik / ggml-js

JavaScript bindings for the ggml-js library
MIT License
41 stars 1 forks source link

How would I use huggingface models? #2

Open ralyodio opened 1 year ago

ralyodio commented 1 year ago

I was told this library would work with node.js and is similar to https://github.com/rustformers/llm

cztomsik commented 1 year ago

There is only RWKV model implemented at the moment. You cannot use it with huggingface models without doing a conversion. Look in the examples/ folder. I will eventually implement more models and add examples there.