search

microsoft / onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
https://onnxruntime.ai
MIT License
14.78k stars 2.94k forks source link

[js/web] Add Wasm Relaxed SIMD support to wasm backend #22794

Open jing-bao opened 1 week ago

jing-bao commented 1 week ago

Description

Add Wasm Relaxed SIMD support. Use integer dot product instructions for QGemmU8X8.

  1. Build with --enable_wasm_relaxed_simd
  2. Use env.wasm.relaxedSimd to run it

Motivation and Context

https://github.com/microsoft/onnxruntime/issues/22533

jing-bao commented 1 week ago

Hi, @fs-eire , would you please take a look? I haven't modified the CI pipeline file yet, just locally pass the unit tests and "npm test". If acceptable, I can add them in a new PR. Also, clang-format will modify many mlas files aside from my added cpp file, so I'm not sure if I need to run that. Maybe you can give me some hints on the file formatting.