search

microsoft / onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
https://onnxruntime.ai
MIT License
14.13k stars 2.85k forks source link

[js][feature tracking] JavaScript library consume #14529

Open fs-eire opened 1 year ago

fs-eire commented 1 year ago

This issue is for tracking tasks and separated issues that related to JavaScript library consumption. This includes TODO items, known issues and feature works that affect any forms of consuming ONNX Runtime JavaScript API via the following library:

Work items tracking table

Works to be done for ORT-Web:

  1. support ES6 export. #10913
    • currently the "module" field is not working in js/web/package.json. Need to: a. switch to ES module for webassembly b. use standard module export c. make webpack behavior correct
  2. support loading from worker/audio worklet. #12589 #13072
  3. support service worker. #14445
  4. support electron #13933
  5. support export for Node.js
  6. update package.json (exports field) so that different projects can consume onnxruntime-web with minimal modification to its webpack configuration. #13736

Works to be done for ORT-Node:

  1. support GPU EP (Cuda/DML/...) #14127
  2. electron compatibility #13086

Example tracking table

The following table is used to track tasks for updating examples to consume ONNX Runtime JavaScript API

Category Status Description PR/Issue # Comments
onnxruntime-node Need update version JavaScript / CommonJS / No_Bundler link
onnxruntime-node Not started JavaScript / ESModule / No_Bundler
onnxruntime-node Not started JavaScript / CommonJS / Webpack Webpack does not deal with node native modules correctly #14505
onnxruntime-node Not started JavaScript / ESModule / Webpack
onnxruntime-web Need update version JavaScript / Web / scriptTag link
onnxruntime-web Need update version JavaScript / Web / CommonJS / Webpack link
onnxruntime-web Not started JavaScript / Web / ESModule / Webpack not working #14504
onnxruntime-web Not started JavaScript / Node / CommonJS / No_Bundler multi-thread CPU EP not available for onnxruntime-web in Node.js binding
onnxruntime-web Not started JavaScript / Node / ESModule / No_Bundler ESModule not available for onnxruntime-web in Node.js binding
onnxruntime-web Not started JavaScript / Node / CommonJS / Webpack
aexposit commented 1 year ago

Hi is there any news on point 2 - support loading from worker/audio worklet ?

chsteinhauer commented 1 year ago

Hi is there any news on point 2 - support loading from worker/audio worklet ?

I'm also interested in this 👀

MountainAndMorning commented 12 months ago

Is the cuda or dml providers available in onnxruntime-node v1.16?

fs-eire commented 11 months ago

Is the cuda or dml providers available in onnxruntime-node v1.16?

They are not supported out-of-the-box and need a few manual steps to enable. We will consider to optimize this in next release.

MountainAndMorning commented 11 months ago

I am developing a tool that relies heavily on onnxruntime-node. Due to the lack of GPU support, the tool runs very slowly. I tried to compile onnxruntime-node, but encountered many problems. Is there a time plan for the release of the npm package, or can you provide the manual steps? Thank you. In the other hand, is there any plan for the coreml backend for onnxruntime-node on the apple silicon platform.

fs-eire commented 11 months ago

we are working on the pipeline changes for Node.js binding.

fs-eire commented 11 months ago

UPDATE: Items (1) and (6) for onnxruntime-web is done by recent change merged into main branch.

MountainAndMorning commented 11 months ago

Thanks for your help.

MountainAndMorning commented 10 months ago

Is there any progress about the coreml backend for onnxruntime-node?@fs-eire