Open Zeesy opened 4 years ago
+1
Unfortunately, the Tokenizers library used internally for tokenization doesn't provide bindings for the browser but only for Nodejs (see huggingface/tokenizers#63), so no build possible for the browser for now :/
Thanks for the update. Are there plans to expand the bindings in the near future?
Currently it's not a priority in our pipeline, but we'll welcome any external contribution :)
is there another way to Browserify this?
Is it possible to put together a browser build for this? It would be really valuable in PWA production.
Thanks so much for your great projects!