search

huggingface / transformers.js

State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!
https://huggingface.co/docs/transformers.js
Apache License 2.0
11.37k stars 708 forks source link

openvino backend #912

Open RGdevz opened 1 month ago

RGdevz commented 1 month ago

Feature request

is it possible to add openvino as backend?

Motivation

it is faster then onnxruntime

Your contribution

gyagp commented 1 month ago

Do you mean Intel's OpenVINO? Unfortunately there is no web support there.

RGdevz commented 1 month ago

Do you mean Intel's OpenVINO? Unfortunately there is no web support there.

Yes, I meant for non web inference like in node js

gyagp commented 1 month ago

I think the current onnxruntime-node only supports CPU, DirectML and CUDA (https://onnxruntime.ai/docs/get-started/with-javascript/node.html).