[Backend] OpenVINO based backend for Linux

intel / webml-polyfill

Deprecated, the Web Neural Network Polyfill project has been moved to https://github.com/webmachinelearning/webnn-polyfill

Apache License 2.0

161 stars 42 forks source link

[Backend] OpenVINO based backend for Linux #653

Closed ibelem closed 5 years ago

huningxin commented 5 years ago

I plan to use open source version of OpenVINO - dldt

huningxin commented 5 years ago

Layout the initial plan for this task

[x] integrate build of dldt/inference_engine (ie) and CPU plugin (MKLDNN) into chromium
[x] implement inference engine based compilation delegate
[x] implement inference engine based execution
[ ] implement ops
[ ] enable GPU plugin
[ ] enable VPU plugin

huningxin commented 5 years ago

https://github.com/otcshare/chromium-src/pull/108 adds ADD, MUL and CONV_2D ops. I will file issues for remaining ops and GPU/VPU plugins.

huningxin commented 5 years ago

Ops:

DEPTHWISE_CONV_2D/ATROUS: https://github.com/intel/webml-polyfill/issues/698
AVERAGE_POOL_2D and MAX_POOL_2D: https://github.com/intel/webml-polyfill/issues/699
CONCATENATION: https://github.com/intel/webml-polyfill/issues/700
SOFTMAX: https://github.com/intel/webml-polyfill/issues/701
RESHAPE: https://github.com/intel/webml-polyfill/issues/702
FULLY_CONNECTED: https://github.com/intel/webml-polyfill/issues/703
RESIZE_BILINEAR: https://github.com/intel/webml-polyfill/issues/704

Plugins:

GPU plugin: https://github.com/intel/webml-polyfill/issues/705
VPU Plugin: https://github.com/intel/webml-polyfill/issues/706

fujunwei commented 5 years ago

otcshare/chromium-src#108 adds ADD, MUL and CONV_2D ops. I will file issues for remaining ops and GPU/VPU plugins.

Nightly version of Linux builds successfully in 8babc60.

huningxin commented 5 years ago

Nightly version of Linux builds successfully in 8babc60.

@fujunwei , thanks! It passes my smoke test. @BruceDai , please help verify the build. To use IE backend, please append --use-inference-engine. Currently, only CPU (MKLDNN) backend is enabled.

Christywl commented 5 years ago

IE backend works on the nightly build ef9d267(--use-inference-engine): https://brucedai.github.io/nt/test/index-local.html?backend=mkldnn Test result: passes 311, failures: 403 And tried some examples(Image Classification), they also work on IE backend.