xenova / transformers.js

State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!
https://huggingface.co/docs/transformers.js
Apache License 2.0
9.87k stars 582 forks source link

Add binary embedding quantization support to FeatureExtraction pipeline #691

Closed jonathanpv closed 2 months ago

jonathanpv commented 2 months ago

This PR addressed the below issue, using the examples from @xenova.

For some reason though I don't get the same similarity numbers as Xenova did on his example but the numbers are at least similar

It may also be beneficial to bring in https://github.com/ashvardanian/SimSIMD for this but haven't ran any benchmarks within browser context yet

HuggingFaceDocBuilderDev commented 2 months ago

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

xenova commented 2 months ago

Great job! Thanks for the PR! 🔥