search

webmachinelearning / webnn-native

🧠⚙️ Standalone native implementation of the Web Neural Network API
Apache License 2.0
50 stars 21 forks source link

[node][DML] Failed to run TinyYolov2 model tests with assertion error. #102

Open BruceDai opened 3 years ago

BruceDai commented 3 years ago

Following WebNN-native Binding for Node.js README, when running TinyYolov2 model tests with Node Binding of WebNN API by DirectML backend, test failed with following assertion error:

test tinyYolov2 nchw
a(0.2928530275821686) b(0.2941698133945465) delta(0.0013167858123779297)
1) test_data_set_0
a(0.4636850357055664) b(0.4621993899345398) delta(0.0014856457710266113)
2) test_data_set_1
a(0.1699068546295166) b(0.16871242225170135) delta(0.0011944323778152466)
3) test_data_set_2

test tinyYolov2 nhwc
a(0.007876233197748661) b(0.002362951636314392) delta(0.005513281561434269)
4) test_data_set_0
a(-0.017894059419631958) b(-0.011623484082520008) delta(0.00627057533711195)
5) test_data_set_1
a(-0.13853715360164642) b(-0.14467230439186096) delta(0.006135150790214539)
6) test_data_set_2

This issue isn't reproduced by Node Binding for OpenVINO backend.

Test Device info: ASUS ZenBook Flip S laptop -- CPU:11th Gen Intel i7-1165G7, GPU:Intel Xe Graphics (driver version 30.0.100.9684)

Windows specifications: Edition:Windows 10 Version:2004 OS build:19041.1110

BruceDai commented 3 years ago

I checked that testing Tiny YOLOv2 ONNX model by ONNX Runtime passed on ASUS ZenBook Flip S laptop -- CPU:11th Gen Intel i7-1165G7, GPU:Intel Xe Graphics (driver version 30.0.100.9805) .