search

intel / webml-polyfill

Deprecated, the Web Neural Network Polyfill project has been moved to https://github.com/webmachinelearning/webnn-polyfill
Apache License 2.0
161 stars 42 forks source link

[test] regression checker fails on Windows #530

Open huningxin opened 5 years ago

huningxin commented 5 years ago

The regression checker continues to fail on my Windows environment. The error log is:

> RegressionChecker@0.0.1 start C:\Users\mltest\code\webml-polyfill\test\tools\RegressionChecker
> node ./src/main.js

RC -- checking runtime environment....
RC -- runtime environment: Windows
RC -- chromium to be tested is installed correctly
RC -- checking chromium code is start

DevTools listening on ws://127.0.0.1:51825/devtools/browser/0d8a13a2-06e9-417e-b114-e8f4cb4c2881
RC -- open remote URL: https://brucedai.github.io/nt/test/index-local.html?backend=cldnn
RC -- Error: EADDRINUSE connect EADDRINUSE 127.0.0.1:58088
(node:1556) UnhandledPromiseRejectionWarning: Error: EADDRINUSE connect EADDRINUSE 127.0.0.1:58088
    at ClientRequest.<anonymous> (C:\Users\mltest\code\webml-polyfill\test\tools\RegressionChecker\node_modules\selenium-webdriver\http\index.js:244:15)
    at emitOne (events.js:116:13)
    at ClientRequest.emit (events.js:211:7)
    at Socket.socketErrorListener (_http_client.js:387:9)
    at emitOne (events.js:116:13)
    at Socket.emit (events.js:211:7)
    at emitErrorNT (internal/streams/destroy.js:64:8)
    at _combinedTickCallback (internal/process/next_tick.js:138:11)
    at process._tickCallback (internal/process/next_tick.js:180:9)
(node:1556) UnhandledPromiseRejectionWarning: Unhandled promise rejection. This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). (rejection id: 2)
(node:1556) [DEP0018] DeprecationWarning: Unhandled promise rejections are deprecated. In the future, promise rejections that are not handled will terminate the Node.js process with a non-zero exit code.

Did I miss anything?

huningxin commented 5 years ago

Use TcpView, it looks like our tool opens too many local port as the screenshot

image

cuiyanx commented 5 years ago

This issue look like webdriver's bug, such as #4162 and #5758. I try to fix it.

cuiyanx commented 5 years ago

Or another way to fix it: System.Net.SocketException - Only one usage of each socket address (protocol/network address/port) is normally permitted

huningxin commented 5 years ago

@BruceDai , or could you please give me some manual steps to do the regression check? Thanks!

cuiyanx commented 5 years ago

@huningxin follow this: System.Net.SocketException - Only one usage of each socket address (protocol/network address/port) is normally permitted

BruceDai commented 5 years ago

@huningxin Sorry for this inconvenient user experience. For this case, please open target chromium browser and type these url and check results manually, thanks. https://brucedai.github.io/nt/test/index-local.html?backend=cldnn https://brucedai.github.io/nt/test/index-local.html?backend=mkldnn https://brucedai.github.io/nt/test/index-local.html?backend=wasm https://brucedai.github.io/nt/test/index-local.html?backend=webgl

Please refer to baseline summary infromation of #Line 72 to #Line 95 of RegressionChecker/baseline/baseline.config.json

huningxin commented 5 years ago

Thanks @BruceDai and @cuiyanx .

I tried

@huningxin follow this: System.Net.SocketException - Only one usage of each socket address (protocol/network address/port) is normally permitted

It works for me. Cheers!

huningxin commented 5 years ago

remove P1 and Jan tag as we have a workaround.

cuiyanx commented 5 years ago

This issue will be fixed with #912 .