tensorflow / ngraph-bridge

TensorFlow-nGraph bridge
Other
137 stars 64 forks source link

How to use PlaidML backend? #129

Open samhodge opened 5 years ago

samhodge commented 5 years ago

OK I got ngraph working with a simple model project that I am not that interested in but it is working:

see: wide_deep.zip

https://github.com/tensorflow/models/commit/b4cf230287c534bac10c78b25c4412ff209cb417#diff-1bcc2f2c0115147dcbe54cff4c19c431

see attached zip

I see

2019-07-04 08:10:44.309831: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-04 08:10:44.355081: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-04 08:10:44.425585: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-04 08:10:44.487407: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-04 08:10:44.556728: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-04 08:10:44.958639: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-04 08:10:45.309306: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU

How do I make it say using backend PlaidML , cooking your AMD GPU to infinity and beyond?

I quickly checked the docs and couldnt see anything useful.

Sam

samhodge commented 5 years ago

Found this:

https://ieee-region6.org/scv-cis/wp-content/uploads/sites/6/2019/03/nGraph_PlaidML.pdf

and this:

https://github.com/NervanaSystems/ngraph/tree/master/src/ngraph/runtime/plaidml

Seems like I need some glue and an instruction manual.

samhodge commented 5 years ago

Slim pickings

https://www.google.com/search?q=use+ngraph+backend+plaidml

samhodge commented 5 years ago

here is the good news

With Ngraph

2019-07-04 08:45:21.758608: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
Done warm up
Step    Img/sec total_loss
1   images/sec: 1105.2 +/- 0.0 (jitter = 0.0)   14.299
10  images/sec: 1079.6 +/- 14.7 (jitter = 19.6) 14.299
20  images/sec: 1077.9 +/- 11.9 (jitter = 24.5) 14.299
30  images/sec: 1074.5 +/- 9.6 (jitter = 37.2)  14.299
40  images/sec: 1065.9 +/- 9.4 (jitter = 41.2)  14.298
50  images/sec: 1060.1 +/- 8.9 (jitter = 39.5)  14.298
60  images/sec: 1062.3 +/- 7.8 (jitter = 35.8)  14.299
70  images/sec: 1063.5 +/- 7.5 (jitter = 35.1)  14.299
80  images/sec: 1066.0 +/- 7.0 (jitter = 38.4)  14.298
90  images/sec: 1066.2 +/- 6.8 (jitter = 38.8)  14.298
100 images/sec: 1066.4 +/- 6.4 (jitter = 41.2)  14.298
----------------------------------------------------------------
total images/sec: 1063.79
----------------------------------------------------------------

Without

Step    Img/sec total_loss
1   images/sec: 564.1 +/- 0.0 (jitter = 0.0)    nan
10  images/sec: 559.9 +/- 4.7 (jitter = 6.6)    nan
20  images/sec: 563.1 +/- 3.2 (jitter = 7.0)    nan
30  images/sec: 565.8 +/- 2.6 (jitter = 9.1)    nan
40  images/sec: 567.0 +/- 2.3 (jitter = 10.4)   nan
50  images/sec: 569.3 +/- 2.4 (jitter = 10.2)   nan
60  images/sec: 570.1 +/- 2.1 (jitter = 10.0)   nan
70  images/sec: 570.3 +/- 1.8 (jitter = 8.8)    nan
80  images/sec: 570.9 +/- 1.7 (jitter = 8.6)    nan
90  images/sec: 570.4 +/- 1.6 (jitter = 8.5)    nan
100 images/sec: 570.7 +/- 1.5 (jitter = 8.9)    nan
----------------------------------------------------------------
total images/sec: 570.05
----------------------------------------------------------------

From https://github.com/tensorflow/benchmarks/blob/cnn_tf_v1.13_compatible/scripts/tf_cnn_benchmarks/tf_cnn_benchmarks.py

samhodge commented 5 years ago

2A894D21-05FB-456B-81CE-864BFFCD06F2 Seems I needed to dig into the code a little deeper

https://github.com/tensorflow/ngraph-bridge/blob/master/python/ngraph_bridge/__init__.in.py

samhodge commented 5 years ago

First you need to build the backend as a flag tho the python script

python build_ngtf.py --use_prebuilt_tensorflow --build_plaidml_backend
samhodge commented 5 years ago

Nearly there

python wide_deep_test.py 
['CPU', 'INTERPRETER', 'PLAIDML', 'NOP']
WARNING: Logging before flag parsing goes to stderr.
W0704 12:14:30.208918 140735662560128 deprecation_wrapper.py:119] From /Users/sam/dev/models/official/utils/logging/hooks.py:26: The name tf.train.SessionRunHook is deprecated. Please use tf.estimator.SessionRunHook instead.

W0704 12:14:30.209583 140735662560128 deprecation_wrapper.py:119] From /Users/sam/dev/models/official/utils/logging/metric_hook.py:26: The name tf.train.LoggingTensorHook is deprecated. Please use tf.estimator.LoggingTensorHook instead.

W0704 12:14:30.209776 140735662560128 deprecation_wrapper.py:119] From wide_deep_test.py:30: The name tf.logging.set_verbosity is deprecated. Please use tf.compat.v1.logging.set_verbosity instead.

W0704 12:14:30.209871 140735662560128 deprecation_wrapper.py:119] From wide_deep_test.py:30: The name tf.logging.ERROR is deprecated. Please use tf.compat.v1.logging.ERROR instead.

Running tests under Python 3.6.5: /Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/bin/python
[ RUN      ] BaseTest.test_end_to_end_deep
Parsing /var/folders/wy/wxfdgdvn23zbw8q9mmv5q0br0000gq/T/wide_deep_testr1njieie/tmpxxr6lkn0/adult.data
2019-07-04 12:14:32.016116: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2019-07-04 12:14:32.073629: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: PLAIDML
[ERR] 2019-07-04T10:14:32z src/ngraph/runtime/plaidml/plaidml_config.cpp 245    Unrecognized PlaidML backend option: 
[ERR] 2019-07-04T10:14:32z src/ngraph/runtime/plaidml/plaidml_config.cpp 257    PlaidML Backend Specification: "PlaidML[:[device_index][,debug][,help][,list_devices][,eventlog=<filename>][,graphviz=<filename>]]".  For example: "PlaidML", "PlaidML:0,list_devices"
libc++abi.dylib: terminating with uncaught exception of type std::invalid_argument: Invalid parameter supplied to PlaidML backend
Fatal Python error: Aborted

Thread 0x000070000183a000 (most recent call first):
  File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/threading.py", line 295 in wait
  File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/queue.py", line 164 in get
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/summary/writer/event_file_writer.py", line 159 in run
  File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/threading.py", line 916 in _bootstrap_inner
  File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/threading.py", line 884 in _bootstrap

Current thread 0x00007fff932c9380 (most recent call first):
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1429 in _call_tf_sessionrun
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1341 in _run_fn
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1356 in _do_call
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1350 in _do_run
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1173 in _run
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 950 in run
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/session_manager.py", line 296 in prepare_session
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 647 in create_session
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 871 in create_session
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 1205 in _create_session
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 1200 in __init__
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 725 in __init__
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 1007 in __init__
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 584 in MonitoredTrainingSession
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow_estimator/python/estimator/estimator.py", line 1480 in _train_with_estimator_spec
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow_estimator/python/estimator/estimator.py", line 1192 in _train_model_default
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow_estimator/python/estimator/estimator.py", line 1158 in _train_model
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow_estimator/python/estimator/estimator.py", line 367 in train
  File "/Users/sam/dev/models/official/wide_deep/wide_deep.py", line 204 in main
  File "/Users/sam/dev/models/official/utils/testing/integration.py", line 58 in run_synthetic
  File "wide_deep_test.py", line 137 in test_end_to_end_deep
  File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/unittest/case.py", line 605 in run
  File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/unittest/case.py", line 653 in __call__
  File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/unittest/suite.py", line 122 in run
  File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/unittest/suite.py", line 84 in __call__
  File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/unittest/suite.py", line 122 in run
  File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/unittest/suite.py", line 84 in __call__
  File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/unittest/runner.py", line 176 in run
  File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/unittest/main.py", line 256 in runTests
  File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/unittest/main.py", line 95 in __init__
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/absl/testing/absltest.py", line 2200 in _run_and_get_tests_result
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/absl/testing/absltest.py", line 2230 in run_tests
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/absl/testing/absltest.py", line 1963 in _run_in_app
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/absl/testing/absltest.py", line 1855 in main
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/platform/googletest.py", line 55 in g_main
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/absl/app.py", line 251 in _run_main
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/absl/app.py", line 300 in run
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/platform/app.py", line 40 in run
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/platform/googletest.py", line 64 in main_wrapper
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/platform/benchmark.py", line 407 in benchmarks_main
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/platform/googletest.py", line 65 in main
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/platform/test.py", line 64 in main
  File "wide_deep_test.py", line 149 in <module>
*** Received signal 6 ***
*** BEGIN MANGLED STACK TRACE ***
*** END MANGLED STACK TRACE ***

*** Begin stack trace ***
*** End stack trace ***
Abort trap: 6
samhodge commented 5 years ago

https://github.com/NervanaSystems/ngraph/blob/master/src/ngraph/runtime/plaidml/plaidml_config.cpp

samhodge commented 5 years ago
>>> print(plaidml.settings.user_settings)
/Users/sam/.plaidml
>>> 
(venv-tf-py3) kaos-new:wide_deep sam$ cat /Users/sam/.plaidml
{
    "PLAIDML_DEVICE_IDS":[
        "metal_amd_radeon_pro_560.0"
    ],
    "PLAIDML_EXPERIMENTAL":false
}
samhodge commented 5 years ago

Maybe this helps

https://github.com/plaidml/plaidml/blob/e01321340e0b53568c58348051b52aaca72a7705/testing/configs_test.py

samhodge commented 5 years ago

More ideas

https://github.com/Lokad/Adrien/blob/master/src/spikes/2/Adrien.Compiler.PlaidML/Settings.cs

samhodge commented 5 years ago

widedeep2.zip Adding updated script with

PLAIDML:0 as backend

error is as follows


     [[{{node ngraph_cluster_153}}]]

======================================================================
ERROR: test_end_to_end_wide_deep (__main__.BaseTest)
test_end_to_end_wide_deep (__main__.BaseTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1356, in _do_call
    return fn(*args)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1341, in _run_fn
    options, feed_dict, fetch_list, target_list, run_metadata)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1429, in _call_tf_sessionrun
    run_metadata)
tensorflow.python.framework.errors_impl.InternalError: Caught exception while executing nGraph computation: Compilation failed: 

program_source:32:7: warning: unused variable 'tid'
  int tid = _tid;
      ^
program_source:134:14: error: call to 'select' is ambiguous
    agg[0] = select((ptrdiff_t)agg[0], (ptrdiff_t)val1, (bool)o0_cond);
             ^~~~~~
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:56:21: note: candidate function
  METAL_FUNC char   select    (char a, char b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:57:21: note: candidate function
  METAL_FUNC uchar  select    (uchar a, uchar b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:58:21: note: candidate function
  METAL_FUNC short  select    (short a, short b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:59:21: note: candidate function
  METAL_FUNC ushort select    (ushort a, ushort b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:60:21: note: candidate function
  METAL_FUNC int    select    (int a, int b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:61:21: note: candidate function
  METAL_FUNC uint   select    (uint a, uint b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:62:21: note: candidate function
  METAL_FUNC half   select    (half a, half b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:63:21: note: candidate function
  METAL_FUNC float  select    (float a, float b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:151:29: note: candidate function
  METAL_FUNC vec<half,2>    select(vec<half,2> a, vec<half,2> b, vec<bool,2> c) { return vec<half,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:152:29: note: candidate function
  METAL_FUNC vec<float,2>   select(vec<float,2> a, vec<float,2> b, vec<bool,2> c) { return vec<float,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:156:29: note: candidate function
  METAL_FUNC vec<half,3>    select(vec<half,3> a, vec<half,3> b, vec<bool,3> c) { return vec<half,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:157:29: note: candidate function
  METAL_FUNC vec<float,3>   select(vec<float,3> a, vec<float,3> b, vec<bool,3> c) { return vec<float,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:161:29: note: candidate function
  METAL_FUNC vec<half,4>    select(vec<half,4> a, vec<half,4> b, vec<bool,4> c) { return vec<half,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:162:29: note: candidate function
  METAL_FUNC vec<float,4>   select(vec<float,4> a, vec<float,4> b, vec<bool,4> c) { return vec<float,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:167:29: note: candidate function
  METAL_FUNC vec<char,2>    select(vec<char,2> a, vec<char,2> b, vec<bool,2> c) { return vec<char,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:168:29: note: candidate function
  METAL_FUNC vec<uchar,2>   select(vec<uchar,2> a, vec<uchar,2> b, vec<bool,2> c) { return vec<uchar,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:169:29: note: candidate function
  METAL_FUNC vec<short,2>   select(vec<short,2> a, vec<short,2> b, vec<bool,2> c) { return vec<short,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:170:29: note: candidate function
  METAL_FUNC vec<ushort,2>  select(vec<ushort,2> a, vec<ushort,2> b, vec<bool,2> c) { return vec<ushort,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:171:29: note: candidate function
  METAL_FUNC vec<int,2>     select(vec<int,2> a, vec<int,2> b, vec<bool,2> c) { return vec<int,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:172:29: note: candidate function
  METAL_FUNC vec<uint,2>    select(vec<uint,2> a, vec<uint,2> b, vec<bool,2> c) { return vec<uint,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:173:29: note: candidate function
  METAL_FUNC vec<char,3>    select(vec<char,3> a, vec<char,3> b, vec<bool,3> c) { return vec<char,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:174:29: note: candidate function
  METAL_FUNC vec<uchar,3>   select(vec<uchar,3> a, vec<uchar,3> b, vec<bool,3> c) { return vec<uchar,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:175:29: note: candidate function
  METAL_FUNC vec<short,3>   select(vec<short,3> a, vec<short,3> b, vec<bool,3> c) { return vec<short,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:176:29: note: candidate function
  METAL_FUNC vec<ushort,3>  select(vec<ushort,3> a, vec<ushort,3> b, vec<bool,3> c) { return vec<ushort,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:177:29: note: candidate function
  METAL_FUNC vec<int,3>     select(vec<int,3> a, vec<int,3> b, vec<bool,3> c) { return vec<int,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:178:29: note: candidate function
  METAL_FUNC vec<uint,3>    select(vec<uint,3> a, vec<uint,3> b, vec<bool,3> c) { return vec<uint,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:179:29: note: candidate function
  METAL_FUNC vec<char,4>    select(vec<char,4> a, vec<char,4> b, vec<bool,4> c) { return vec<char,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:180:29: note: candidate function
  METAL_FUNC vec<uchar,4>   select(vec<uchar,4> a, vec<uchar,4> b, vec<bool,4> c) { return vec<uchar,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:181:29: note: candidate function
  METAL_FUNC vec<short,4>   select(vec<short,4> a, vec<short,4> b, vec<bool,4> c) { return vec<short,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:182:29: note: candidate function
  METAL_FUNC vec<ushort,4>  select(vec<ushort,4> a, vec<ushort,4> b, vec<bool,4> c) { return vec<ushort,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:183:29: note: candidate function
  METAL_FUNC vec<int,4>     select(vec<int,4> a, vec<int,4> b, vec<bool,4> c) { return vec<int,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:184:29: note: candidate function
  METAL_FUNC vec<uint,4>    select(vec<uint,4> a, vec<uint,4> b, vec<bool,4> c) { return vec<uint,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^

     [[{{node ngraph_cluster_344}}]]

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "wide_deep_test.py", line 145, in test_end_to_end_wide_deep
    synth=False, max_train=None)
  File "/Users/sam/dev/models/official/utils/testing/integration.py", line 58, in run_synthetic
    main(args)
  File "/Users/sam/dev/models/official/wide_deep/wide_deep.py", line 204, in main
    model.train(input_fn=train_input_fn, hooks=train_hooks)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow_estimator/python/estimator/estimator.py", line 367, in train
    loss = self._train_model(input_fn, hooks, saving_listeners)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow_estimator/python/estimator/estimator.py", line 1158, in _train_model
    return self._train_model_default(input_fn, hooks, saving_listeners)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow_estimator/python/estimator/estimator.py", line 1192, in _train_model_default
    saving_listeners)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow_estimator/python/estimator/estimator.py", line 1484, in _train_with_estimator_spec
    _, loss = mon_sess.run([estimator_spec.train_op, estimator_spec.loss])
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 754, in run
    run_metadata=run_metadata)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 1252, in run
    run_metadata=run_metadata)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 1353, in run
    raise six.reraise(*original_exc_info)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/six.py", line 693, in reraise
    raise value
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 1338, in run
    return self._sess.run(*args, **kwargs)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 1411, in run
    run_metadata=run_metadata)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 1169, in run
    return self._sess.run(*args, **kwargs)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 950, in run
    run_metadata_ptr)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1173, in _run
    feed_dict_tensor, options, run_metadata)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1350, in _do_run
    run_metadata)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1370, in _do_call
    raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.InternalError: Caught exception while executing nGraph computation: Compilation failed: 

program_source:32:7: warning: unused variable 'tid'
  int tid = _tid;
      ^
program_source:134:14: error: call to 'select' is ambiguous
    agg[0] = select((ptrdiff_t)agg[0], (ptrdiff_t)val1, (bool)o0_cond);
             ^~~~~~
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:56:21: note: candidate function
  METAL_FUNC char   select    (char a, char b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:57:21: note: candidate function
  METAL_FUNC uchar  select    (uchar a, uchar b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:58:21: note: candidate function
  METAL_FUNC short  select    (short a, short b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:59:21: note: candidate function
  METAL_FUNC ushort select    (ushort a, ushort b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:60:21: note: candidate function
  METAL_FUNC int    select    (int a, int b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:61:21: note: candidate function
  METAL_FUNC uint   select    (uint a, uint b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:62:21: note: candidate function
  METAL_FUNC half   select    (half a, half b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:63:21: note: candidate function
  METAL_FUNC float  select    (float a, float b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:151:29: note: candidate function
  METAL_FUNC vec<half,2>    select(vec<half,2> a, vec<half,2> b, vec<bool,2> c) { return vec<half,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:152:29: note: candidate function
  METAL_FUNC vec<float,2>   select(vec<float,2> a, vec<float,2> b, vec<bool,2> c) { return vec<float,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:156:29: note: candidate function
  METAL_FUNC vec<half,3>    select(vec<half,3> a, vec<half,3> b, vec<bool,3> c) { return vec<half,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:157:29: note: candidate function
  METAL_FUNC vec<float,3>   select(vec<float,3> a, vec<float,3> b, vec<bool,3> c) { return vec<float,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:161:29: note: candidate function
  METAL_FUNC vec<half,4>    select(vec<half,4> a, vec<half,4> b, vec<bool,4> c) { return vec<half,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:162:29: note: candidate function
  METAL_FUNC vec<float,4>   select(vec<float,4> a, vec<float,4> b, vec<bool,4> c) { return vec<float,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:167:29: note: candidate function
  METAL_FUNC vec<char,2>    select(vec<char,2> a, vec<char,2> b, vec<bool,2> c) { return vec<char,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:168:29: note: candidate function
  METAL_FUNC vec<uchar,2>   select(vec<uchar,2> a, vec<uchar,2> b, vec<bool,2> c) { return vec<uchar,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:169:29: note: candidate function
  METAL_FUNC vec<short,2>   select(vec<short,2> a, vec<short,2> b, vec<bool,2> c) { return vec<short,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:170:29: note: candidate function
  METAL_FUNC vec<ushort,2>  select(vec<ushort,2> a, vec<ushort,2> b, vec<bool,2> c) { return vec<ushort,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:171:29: note: candidate function
  METAL_FUNC vec<int,2>     select(vec<int,2> a, vec<int,2> b, vec<bool,2> c) { return vec<int,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:172:29: note: candidate function
  METAL_FUNC vec<uint,2>    select(vec<uint,2> a, vec<uint,2> b, vec<bool,2> c) { return vec<uint,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:173:29: note: candidate function
  METAL_FUNC vec<char,3>    select(vec<char,3> a, vec<char,3> b, vec<bool,3> c) { return vec<char,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:174:29: note: candidate function
  METAL_FUNC vec<uchar,3>   select(vec<uchar,3> a, vec<uchar,3> b, vec<bool,3> c) { return vec<uchar,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:175:29: note: candidate function
  METAL_FUNC vec<short,3>   select(vec<short,3> a, vec<short,3> b, vec<bool,3> c) { return vec<short,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:176:29: note: candidate function
  METAL_FUNC vec<ushort,3>  select(vec<ushort,3> a, vec<ushort,3> b, vec<bool,3> c) { return vec<ushort,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:177:29: note: candidate function
  METAL_FUNC vec<int,3>     select(vec<int,3> a, vec<int,3> b, vec<bool,3> c) { return vec<int,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:178:29: note: candidate function
  METAL_FUNC vec<uint,3>    select(vec<uint,3> a, vec<uint,3> b, vec<bool,3> c) { return vec<uint,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:179:29: note: candidate function
  METAL_FUNC vec<char,4>    select(vec<char,4> a, vec<char,4> b, vec<bool,4> c) { return vec<char,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:180:29: note: candidate function
  METAL_FUNC vec<uchar,4>   select(vec<uchar,4> a, vec<uchar,4> b, vec<bool,4> c) { return vec<uchar,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:181:29: note: candidate function
  METAL_FUNC vec<short,4>   select(vec<short,4> a, vec<short,4> b, vec<bool,4> c) { return vec<short,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:182:29: note: candidate function
  METAL_FUNC vec<ushort,4>  select(vec<ushort,4> a, vec<ushort,4> b, vec<bool,4> c) { return vec<ushort,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:183:29: note: candidate function
  METAL_FUNC vec<int,4>     select(vec<int,4> a, vec<int,4> b, vec<bool,4> c) { return vec<int,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:184:29: note: candidate function
  METAL_FUNC vec<uint,4>    select(vec<uint,4> a, vec<uint,4> b, vec<bool,4> c) { return vec<uint,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^

     [[{{node ngraph_cluster_344}}]]

======================================================================
ERROR: test_wide_deep_estimator_training (__main__.BaseTest)
test_wide_deep_estimator_training (__main__.BaseTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1356, in _do_call
    return fn(*args)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1341, in _run_fn
    options, feed_dict, fetch_list, target_list, run_metadata)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1429, in _call_tf_sessionrun
    run_metadata)
tensorflow.python.framework.errors_impl.InternalError: Caught exception while executing nGraph computation: SC compilation failure
Likely a problem in input program, however cannot be more specific

     [[{{node ngraph_cluster_495}}]]

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "wide_deep_test.py", line 121, in test_wide_deep_estimator_training
    self.build_and_test_estimator('wide_deep')
  File "wide_deep_test.py", line 103, in build_and_test_estimator
    model.train(input_fn=get_input_fn(1, True, 1), steps=1)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow_estimator/python/estimator/estimator.py", line 367, in train
    loss = self._train_model(input_fn, hooks, saving_listeners)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow_estimator/python/estimator/estimator.py", line 1158, in _train_model
    return self._train_model_default(input_fn, hooks, saving_listeners)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow_estimator/python/estimator/estimator.py", line 1192, in _train_model_default
    saving_listeners)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow_estimator/python/estimator/estimator.py", line 1484, in _train_with_estimator_spec
    _, loss = mon_sess.run([estimator_spec.train_op, estimator_spec.loss])
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 754, in run
    run_metadata=run_metadata)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 1252, in run
    run_metadata=run_metadata)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 1353, in run
    raise six.reraise(*original_exc_info)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/six.py", line 693, in reraise
    raise value
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 1338, in run
    return self._sess.run(*args, **kwargs)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 1411, in run
    run_metadata=run_metadata)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 1169, in run
    return self._sess.run(*args, **kwargs)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 950, in run
    run_metadata_ptr)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1173, in _run
    feed_dict_tensor, options, run_metadata)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1350, in _do_run
    run_metadata)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1370, in _do_call
    raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.InternalError: Caught exception while executing nGraph computation: SC compilation failure
Likely a problem in input program, however cannot be more specific

     [[{{node ngraph_cluster_495}}]]

----------------------------------------------------------------------
Ran 6 tests in 17.547s

FAILED (errors=4)
samhodge commented 5 years ago

This is what I see from the gtest

(venv-tf-py3) kaos-new:test sam$ pwd
/Users/sam/dev/ngraph-bridge/build_cmake/test
(venv-tf-py3) kaos-new:test sam$ ./gtest_ngtf 
[==========] Running 181 tests from 14 test cases.
[----------] Global test environment set-up.
[----------] 1 test from graph_exec
[ RUN      ] graph_exec.axpy
Calling nGraph function
Tensor<Result_5: 2, 3>{[[6, 6, 6], [6, 6, 6]]}
Tensor<Result_6: 2, 3>{[[5, 5, 5], [5, 5, 5]]}
[       OK ] graph_exec.axpy (48 ms)
[----------] 1 test from graph_exec (48 ms total)

[----------] 3 tests from tf_exec
[ RUN      ] tf_exec.hello_world
2019-07-09 07:35:54.857708: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2019-07-09 07:35:54.859329: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:54.860795: I /Users/sam/dev/ngraph-bridge/test/tf_exec.cpp:61] 19
-3
[       OK ] tf_exec.hello_world (3 ms)
[ RUN      ] tf_exec.axpy
2019-07-09 07:35:54.863587: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
5 5 5 5 5 5 
6 6 6 6 6 6 
[       OK ] tf_exec.axpy (9 ms)
[ RUN      ] tf_exec.BatchMatMul
2019-07-09 07:35:54.870772: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:54.874895: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:54.879077: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:54.882073: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.882893: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.883889: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.884964: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] tf_exec.BatchMatMul (16 ms)
[----------] 3 tests from tf_exec (28 ms total)

[----------] 3 tests from padding
[ RUN      ] padding.valid
[       OK ] padding.valid (0 ms)
[ RUN      ] padding.divisible
[       OK ] padding.divisible (0 ms)
[ RUN      ] padding.indivisible
[       OK ] padding.indivisible (0 ms)
[----------] 3 tests from padding (0 ms total)

[----------] 7 tests from conversions
[ RUN      ] conversions.reshape
[       OK ] conversions.reshape (0 ms)
[ RUN      ] conversions.batch_to_tensorflow_nchw
[       OK ] conversions.batch_to_tensorflow_nchw (0 ms)
[ RUN      ] conversions.batch_to_tensorflow_nhwc
[       OK ] conversions.batch_to_tensorflow_nhwc (0 ms)
[ RUN      ] conversions.batch_to_ngraph_nchw
[       OK ] conversions.batch_to_ngraph_nchw (0 ms)
[ RUN      ] conversions.param_to_ngraph_nchw
[       OK ] conversions.param_to_ngraph_nchw (0 ms)
[ RUN      ] conversions.batch_to_ngraph_nhwc
[       OK ] conversions.batch_to_ngraph_nhwc (0 ms)
[ RUN      ] conversions.param_to_ngraph_nhwc
[       OK ] conversions.param_to_ngraph_nhwc (0 ms)
[----------] 7 tests from conversions (0 ms total)

[----------] 2 tests from AssignClusters
[ RUN      ] AssignClusters.ConstToStatic
[       OK ] AssignClusters.ConstToStatic (0 ms)
[ RUN      ] AssignClusters.Cone
[       OK ] AssignClusters.Cone (0 ms)
[----------] 2 tests from AssignClusters (0 ms total)

[----------] 6 tests from DeadnessCheck
[ RUN      ] DeadnessCheck.livedead1
[       OK ] DeadnessCheck.livedead1 (1 ms)
[ RUN      ] DeadnessCheck.DTestG1
[       OK ] DeadnessCheck.DTestG1 (0 ms)
[ RUN      ] DeadnessCheck.DTestG2
[       OK ] DeadnessCheck.DTestG2 (1 ms)
[ RUN      ] DeadnessCheck.DTestG3
[       OK ] DeadnessCheck.DTestG3 (0 ms)
[ RUN      ] DeadnessCheck.DTestG4New
[       OK ] DeadnessCheck.DTestG4New (0 ms)
[ RUN      ] DeadnessCheck.DTestG5
[       OK ] DeadnessCheck.DTestG5 (1 ms)
[----------] 6 tests from DeadnessCheck (3 ms total)

[----------] 7 tests from BackendManager
[ RUN      ] BackendManager.SetBackend
[       OK ] BackendManager.SetBackend (0 ms)
[ RUN      ] BackendManager.GetSupportedBackendNames
[       OK ] BackendManager.GetSupportedBackendNames (0 ms)
[ RUN      ] BackendManager.BackendAssignment
[       OK ] BackendManager.BackendAssignment (1 ms)
[ RUN      ] BackendManager.BackendClustering
[       OK ] BackendManager.BackendClustering (0 ms)
[ RUN      ] BackendManager.GetBackendAdditionalAttributes
[       OK ] BackendManager.GetBackendAdditionalAttributes (0 ms)
[ RUN      ] BackendManager.GetBackendAttributeValues
[       OK ] BackendManager.GetBackendAttributeValues (0 ms)
[ RUN      ] BackendManager.GetBackendCreationString
[       OK ] BackendManager.GetBackendCreationString (0 ms)
[----------] 7 tests from BackendManager (1 ms total)

[----------] 1 test from EncapsulateClusters
[ RUN      ] EncapsulateClusters.PopulateLibrary
[       OK ] EncapsulateClusters.PopulateLibrary (0 ms)
[----------] 1 test from EncapsulateClusters (0 ms total)

[----------] 4 tests from DisableOps
[ RUN      ] DisableOps.SimpleSettingAndGetting1
[       OK ] DisableOps.SimpleSettingAndGetting1 (0 ms)
[ RUN      ] DisableOps.SimpleSettingAndGetting2
[       OK ] DisableOps.SimpleSettingAndGetting2 (0 ms)
[ RUN      ] DisableOps.SimpleSettingAndGetting3
[       OK ] DisableOps.SimpleSettingAndGetting3 (0 ms)
[ RUN      ] DisableOps.DisableTest
[       OK ] DisableOps.DisableTest (1 ms)
[----------] 4 tests from DisableOps (1 ms total)

[----------] 1 test from MarkForClustering
[ RUN      ] MarkForClustering.SimpleTest
[       OK ] MarkForClustering.SimpleTest (0 ms)
[----------] 1 test from MarkForClustering (0 ms total)

[----------] 61 tests from MathOps
[ RUN      ] MathOps.Abs1D
2019-07-09 07:35:54.894927: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.895095: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Abs1D (5 ms)
[ RUN      ] MathOps.Abs2D
2019-07-09 07:35:54.898804: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.898961: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Abs2D (4 ms)
[ RUN      ] MathOps.Add
2019-07-09 07:35:54.902397: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.902564: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Add (4 ms)
[ RUN      ] MathOps.AddN
2019-07-09 07:35:54.906377: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.907144: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.AddN (4 ms)
[ RUN      ] MathOps.AnyKeepDims
2019-07-09 07:35:54.912975: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.913199: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.AnyKeepDims (6 ms)
[ RUN      ] MathOps.AnyNegativeAxis
2019-07-09 07:35:54.917086: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.917277: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.AnyNegativeAxis (4 ms)
[ RUN      ] MathOps.AnyPositiveAxis
2019-07-09 07:35:54.920915: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.921106: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.AnyPositiveAxis (4 ms)
[ RUN      ] MathOps.AllKeepDims
2019-07-09 07:35:54.925571: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.925759: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.AllKeepDims (5 ms)
[ RUN      ] MathOps.AllNegativeAxis
2019-07-09 07:35:54.929625: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.929798: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.AllNegativeAxis (4 ms)
[ RUN      ] MathOps.AllPositiveAxis
2019-07-09 07:35:54.933252: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.933411: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.AllPositiveAxis (3 ms)
[ RUN      ] MathOps.Sum
2019-07-09 07:35:54.937104: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.937270: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.940693: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.940852: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.944705: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.944911: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.948501: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.948720: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.952486: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.952660: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.956285: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.956482: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Sum (24 ms)
[ RUN      ] MathOps.Mean
2019-07-09 07:35:54.961018: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.961375: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.965457: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.965685: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.969773: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.969964: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.973714: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.973971: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.977995: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.978157: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.981816: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.981976: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Mean (25 ms)
[ RUN      ] MathOps.Prod
2019-07-09 07:35:54.985591: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.985748: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.989194: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.989358: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.993042: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.993212: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.996924: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.997095: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.000735: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.000895: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.004699: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.004884: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Prod (23 ms)
[ RUN      ] MathOps.ArgMaxNeg
2019-07-09 07:35:55.008880: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.009084: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.ArgMaxNeg (4 ms)
[ RUN      ] MathOps.ArgMaxPos
2019-07-09 07:35:55.012755: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.012927: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.ArgMaxPos (4 ms)
[ RUN      ] MathOps.ArgMinNeg
2019-07-09 07:35:55.016227: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.016384: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.ArgMinNeg (3 ms)
[ RUN      ] MathOps.ArgMinPos
2019-07-09 07:35:55.019751: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.019914: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.ArgMinPos (4 ms)
[ RUN      ] MathOps.BatchMatMul2D
2019-07-09 07:35:55.024741: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.024909: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.BatchMatMul2D (18 ms)
[ RUN      ] MathOps.BatchMatMul2DAdjX
2019-07-09 07:35:55.041942: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.042139: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.BatchMatMul2DAdjX (4 ms)
[ RUN      ] MathOps.BatchMatMul2DAdjY
2019-07-09 07:35:55.046063: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.046247: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.BatchMatMul2DAdjY (4 ms)
[ RUN      ] MathOps.BatchMatMul2DAdjXY
2019-07-09 07:35:55.049817: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.049979: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.BatchMatMul2DAdjXY (4 ms)
[ RUN      ] MathOps.BatchMatMul3D
2019-07-09 07:35:55.053833: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.054053: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.BatchMatMul3D (4 ms)
[ RUN      ] MathOps.BatchMatMul3DAdjX
2019-07-09 07:35:55.060337: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.060613: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.BatchMatMul3DAdjX (7 ms)
[ RUN      ] MathOps.BatchMatMul3DAdjY
2019-07-09 07:35:55.064651: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.064924: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.BatchMatMul3DAdjY (4 ms)
[ RUN      ] MathOps.BatchMatMul3DAdjXY
2019-07-09 07:35:55.068903: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.069096: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.BatchMatMul3DAdjXY (4 ms)
[ RUN      ] MathOps.BatchMatMul4D
2019-07-09 07:35:55.072963: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.073135: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.BatchMatMul4D (4 ms)
[ RUN      ] MathOps.BatchMatMul4DAdjX
2019-07-09 07:35:55.077310: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.077485: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.BatchMatMul4DAdjX (4 ms)
[ RUN      ] MathOps.BatchMatMul4DAdjY
2019-07-09 07:35:55.081585: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.081753: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.BatchMatMul4DAdjY (4 ms)
[ RUN      ] MathOps.BatchMatMul4DAdjXY
2019-07-09 07:35:55.086038: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.086245: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.BatchMatMul4DAdjXY (4 ms)
[ RUN      ] MathOps.Cast1D
2019-07-09 07:35:55.089523: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.089696: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Cast1D (4 ms)
[ RUN      ] MathOps.Cast2D
2019-07-09 07:35:55.093002: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.093188: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Cast2D (3 ms)
[ RUN      ] MathOps.Exp1D
2019-07-09 07:35:55.099885: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.100120: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Exp1D (7 ms)
[ RUN      ] MathOps.Exp2D
2019-07-09 07:35:55.104657: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.104877: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Exp2D (5 ms)
[ RUN      ] MathOps.FloorDiv
2019-07-09 07:35:55.108444: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.108615: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.FloorDiv (4 ms)
[ RUN      ] MathOps.FloorDivBroadcasting
2019-07-09 07:35:55.112586: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.112793: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.FloorDivBroadcasting (4 ms)
[ RUN      ] MathOps.FloorDivNegFloat
2019-07-09 07:35:55.118244: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.118475: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.FloorDivNegFloat (6 ms)
[ RUN      ] MathOps.FloorMod
2019-07-09 07:35:55.122862: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.123028: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.FloorMod (4 ms)
[ RUN      ] MathOps.FloorModBroadcasting
2019-07-09 07:35:55.129726: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.129948: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.FloorModBroadcasting (7 ms)
[ RUN      ] MathOps.FloorModNegFloat
2019-07-09 07:35:55.134143: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.134370: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.FloorModNegFloat (4 ms)
[ RUN      ] MathOps.Log1D
2019-07-09 07:35:55.137811: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.137960: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Log1D (4 ms)
[ RUN      ] MathOps.Log2D
2019-07-09 07:35:55.141235: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.141425: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Log2D (3 ms)
[ RUN      ] MathOps.LogicalOr
2019-07-09 07:35:55.145273: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.145495: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.LogicalOr (5 ms)
[ RUN      ] MathOps.MaxNegativeAxis
2019-07-09 07:35:55.149926: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.150145: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.MaxNegativeAxis (4 ms)
[ RUN      ] MathOps.MaxPositiveAxis
2019-07-09 07:35:55.154709: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.154920: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.MaxPositiveAxis (5 ms)
[ RUN      ] MathOps.MinNegativeAxis
2019-07-09 07:35:55.159709: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.159994: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.MinNegativeAxis (5 ms)
[ RUN      ] MathOps.MinPositiveAxis
2019-07-09 07:35:55.163787: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.163981: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.MinPositiveAxis (4 ms)
[ RUN      ] MathOps.Minimum
2019-07-09 07:35:55.167584: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.167801: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Minimum (4 ms)
[ RUN      ] MathOps.MinimumBroadcasting
2019-07-09 07:35:55.171518: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.171696: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.MinimumBroadcasting (4 ms)
[ RUN      ] MathOps.Negate
2019-07-09 07:35:55.175091: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.175283: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Negate (3 ms)
[ RUN      ] MathOps.Pow1D
2019-07-09 07:35:55.179431: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.179649: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Pow1D (5 ms)
[ RUN      ] MathOps.Pow2D
2019-07-09 07:35:55.184329: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.184508: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Pow2D (5 ms)
[ RUN      ] MathOps.RealDiv
2019-07-09 07:35:55.188479: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.188650: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.RealDiv (4 ms)
[ RUN      ] MathOps.RealDivBroadcasting
2019-07-09 07:35:55.193011: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.193230: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.RealDivBroadcasting (4 ms)
[ RUN      ] MathOps.Reciprocal
2019-07-09 07:35:55.197511: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.197741: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Reciprocal (5 ms)
[ RUN      ] MathOps.Rsqrt
2019-07-09 07:35:55.201270: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.201444: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Rsqrt (4 ms)
[ RUN      ] MathOps.Square
2019-07-09 07:35:55.204908: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.205082: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Square (3 ms)
[ RUN      ] MathOps.SqueezeNoAttributes
2019-07-09 07:35:55.208562: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.208737: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.212929: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.213155: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.217163: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.217365: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.220940: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.221097: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.SqueezeNoAttributes (16 ms)
[ RUN      ] MathOps.SqueezeWithAttributes
2019-07-09 07:35:55.224740: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.224900: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.229397: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.229633: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.233606: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.233802: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.SqueezeWithAttributes (13 ms)
[ RUN      ] MathOps.Sqrt
2019-07-09 07:35:55.237172: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.237331: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Sqrt (3 ms)
[ RUN      ] MathOps.SquaredDifference
2019-07-09 07:35:55.240946: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.241113: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.SquaredDifference (4 ms)
[ RUN      ] MathOps.SquaredDifferenceBroadcasting
2019-07-09 07:35:55.245282: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.245479: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.SquaredDifferenceBroadcasting (5 ms)
[----------] 61 tests from MathOps (356 ms total)

[----------] 34 tests from NNOps
[ RUN      ] NNOps.BiasAddGrad
2019-07-09 07:35:55.248884: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.249052: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.252602: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.252756: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.256257: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.256429: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.259939: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.260136: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.263573: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.263760: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.BiasAddGrad (18 ms)
[ RUN      ] NNOps.Conv2DBackpropFilterNCHWSame
2019-07-09 07:35:55.269630: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.271050: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.Conv2DBackpropFilterNCHWSame (7 ms)
[ RUN      ] NNOps.Conv2DBackpropFilterNCHWSameWithDilation
[       OK ] NNOps.Conv2DBackpropFilterNCHWSameWithDilation (5 ms)
[ RUN      ] NNOps.Conv2DBackpropFilterNCHWValid
2019-07-09 07:35:55.280330: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.281397: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.Conv2DBackpropFilterNCHWValid (5 ms)
[ RUN      ] NNOps.Conv2DBackpropFilterNCHWValidWithDilation
[       OK ] NNOps.Conv2DBackpropFilterNCHWValidWithDilation (4 ms)
[ RUN      ] NNOps.Conv2DBackpropFilterNHWCSame
2019-07-09 07:35:55.288908: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.289737: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.Conv2DBackpropFilterNHWCSame (5 ms)
[ RUN      ] NNOps.Conv2DBackpropFilterNHWCSameWithDilation
[       OK ] NNOps.Conv2DBackpropFilterNHWCSameWithDilation (3 ms)
[ RUN      ] NNOps.Conv2DBackpropFilterNHWCValid
2019-07-09 07:35:55.298199: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.299077: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.Conv2DBackpropFilterNHWCValid (6 ms)
[ RUN      ] NNOps.Conv2DBackpropFilterNHWCValidWithDilation
[       OK ] NNOps.Conv2DBackpropFilterNHWCValidWithDilation (4 ms)
[ RUN      ] NNOps.Conv2DBackpropInputNCHWSame
2019-07-09 07:35:55.307299: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.308425: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.Conv2DBackpropInputNCHWSame (5 ms)
[ RUN      ] NNOps.Conv2DBackpropInputNCHWSameWithDilation
[       OK ] NNOps.Conv2DBackpropInputNCHWSameWithDilation (4 ms)
[ RUN      ] NNOps.Conv2DBackpropInputNCHWValid
2019-07-09 07:35:55.316602: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.317637: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.Conv2DBackpropInputNCHWValid (6 ms)
[ RUN      ] NNOps.Conv2DBackpropInputNCHWValidWithDilation
[       OK ] NNOps.Conv2DBackpropInputNCHWValidWithDilation (3 ms)
[ RUN      ] NNOps.Conv2DBackpropInputNHWC
2019-07-09 07:35:55.325851: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.327073: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.331506: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.332302: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.Conv2DBackpropInputNHWC (11 ms)
[ RUN      ] NNOps.Conv2DBackpropInputNHWCWithDilation
[       OK ] NNOps.Conv2DBackpropInputNHWCWithDilation (8 ms)
[ RUN      ] NNOps.Conv3DNDHWCSame
2019-07-09 07:35:55.343704: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.343953: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.Conv3DNDHWCSame (4 ms)
[ RUN      ] NNOps.FusedBatchNormV2NHWCInference
2019-07-09 07:35:55.359465: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.395109: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.FusedBatchNormV2NHWCInference (55 ms)
[ RUN      ] NNOps.FusedBatchNormV2NHWCTraining
2019-07-09 07:35:55.411609: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.433835: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.FusedBatchNormV2NHWCTraining (49 ms)
[ RUN      ] NNOps.FusedBatchNormV3NHWCInference
2019-07-09 07:35:55.458473: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.486647: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.FusedBatchNormV3NHWCInference (43 ms)
[ RUN      ] NNOps.FusedBatchNormV3NHWCTraining
2019-07-09 07:35:55.503744: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.527779: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.FusedBatchNormV3NHWCTraining (53 ms)
[ RUN      ] NNOps.FusedBatchNormGradNHWC
2019-07-09 07:35:55.548913: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.551547: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.558007: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.559957: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.FusedBatchNormGradNHWC (17 ms)
[ RUN      ] NNOps.FusedBatchNormGradV3NHWC
2019-07-09 07:35:55.566168: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.568449: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.574767: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.576813: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.FusedBatchNormGradV3NHWC (16 ms)
[ RUN      ] NNOps.L2Loss
2019-07-09 07:35:55.581341: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.581492: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.585059: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.585332: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.L2Loss (7 ms)
[ RUN      ] NNOps.LogSoftmax
2019-07-09 07:35:55.590344: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.590515: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.595146: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.595296: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.600628: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.600829: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.606273: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.606436: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.611374: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.611573: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.LogSoftmax (27 ms)
[ RUN      ] NNOps.MaxPool3DNDHWCSame
2019-07-09 07:35:55.615544: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.615762: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.637471: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.638194: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.MaxPool3DNDHWCSame (76 ms)
[ RUN      ] NNOps.MaxPool3DNDHWCValid
2019-07-09 07:35:55.691968: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.692176: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.715140: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.716123: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.MaxPool3DNDHWCValid (74 ms)
[ RUN      ] NNOps.QuantizedAvgPoolEvenInput
2019-07-09 07:35:55.765989: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.767596: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.772177: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.773753: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.779052: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.780633: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.787462: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.789296: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.794670: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.796303: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.801869: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.803610: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.808592: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.810085: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.815855: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.817613: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.822522: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.824082: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.829226: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.830754: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.835637: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.837155: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.841788: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.843308: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.847922: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.849378: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.854481: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.856000: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.860671: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.862229: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.867180: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.868741: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.873161: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.874606: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.879423: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.880908: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.885805: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.887355: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.891891: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.893352: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.897810: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.899232: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.904022: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.905541: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.910303: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.911883: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.917050: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.918619: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.923238: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.924748: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.929717: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.931317: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.936084: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.937622: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.942212: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.943829: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.948367: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.949906: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.954740: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.956240: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.960849: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.962371: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.967270: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.968800: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.QuantizedAvgPoolEvenInput (207 ms)
[ RUN      ] NNOps.QuantizedMaxPool
2019-07-09 07:35:55.973624: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.975109: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.980011: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.981495: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.986183: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.987700: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.992366: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.993949: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.998361: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.999906: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.005248: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.007004: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.011995: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.013706: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.018632: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.020186: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.024551: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.025967: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.030748: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.032186: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.036485: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.037863: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.042222: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.043751: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.047943: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.049406: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.054187: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.055693: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.060241: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.061739: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.066982: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.068496: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.072918: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.074327: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.078915: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.080401: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.084684: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.086221: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.090655: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.092083: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.096459: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.097839: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.102546: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.103998: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.108486: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.110061: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.115112: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.116588: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.120976: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.122373: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.126713: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.128267: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.132901: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.134331: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.138785: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.140255: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.144673: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.146057: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.150487: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.152067: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.156692: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.158160: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.163245: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.164768: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.QuantizedMaxPool (196 ms)
[ RUN      ] NNOps.QuantizedMaxPoolSameMinMax
2019-07-09 07:35:56.169387: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.170348: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.QuantizedMaxPoolSameMinMax (6 ms)
[ RUN      ] NNOps.Softmax2D
2019-07-09 07:35:56.173861: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.174034: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.Softmax2D (3 ms)
[ RUN      ] NNOps.Softmax3D
2019-07-09 07:35:56.177366: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.177545: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.Softmax3D (4 ms)
[ RUN      ] NNOps.SoftmaxZeroDimTest1
2019-07-09 07:35:56.181103: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.181258: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.SoftmaxZeroDimTest1 (3 ms)
[ RUN      ] NNOps.SoftmaxZeroDimTest2
2019-07-09 07:35:56.184318: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.184460: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.SoftmaxZeroDimTest2 (4 ms)
[ RUN      ] NNOps.SparseSoftmaxCrossEntropyWithLogits
2019-07-09 07:35:56.190277: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.190457: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.SparseSoftmaxCrossEntropyWithLogits (6 ms)
[----------] 34 tests from NNOps (945 ms total)

[----------] 45 tests from ArrayOps
[ RUN      ] ArrayOps.DepthToSpaceNHWC
2019-07-09 07:35:56.194253: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.194405: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.197784: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.198007: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.201618: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.201781: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.205348: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.205569: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.209491: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.209740: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.214172: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.214397: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.218332: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.218495: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.DepthToSpaceNHWC (28 ms)
[ RUN      ] ArrayOps.DepthToSpaceNCHW
2019-07-09 07:35:56.222441: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.223284: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.226971: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.227873: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.231762: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.232595: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.236215: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.237028: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.240726: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.241560: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.245274: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.246465: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.273148: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.322398: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.DepthToSpaceNCHW (112 ms)
[ RUN      ] ArrayOps.Dequantizei8
2019-07-09 07:35:56.335153: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.335987: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.Dequantizei8 (5 ms)
[ RUN      ] ArrayOps.Dequantizei8TF1
2019-07-09 07:35:56.340097: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.340773: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.Dequantizei8TF1 (5 ms)
[ RUN      ] ArrayOps.Dequantizei8TF3
2019-07-09 07:35:56.344873: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.345532: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.Dequantizei8TF3 (4 ms)
[ RUN      ] ArrayOps.Dequantizeu8
2019-07-09 07:35:56.349596: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.350241: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.Dequantizeu8 (5 ms)
[ RUN      ] ArrayOps.Fill
2019-07-09 07:35:56.353551: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.353710: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.357133: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.357294: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.360915: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.361096: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.364746: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.364919: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.368379: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.368580: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.Fill (19 ms)
[ RUN      ] ArrayOps.ExpandDims
2019-07-09 07:35:56.372318: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.372529: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.376212: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.376442: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.ExpandDims (8 ms)
[ RUN      ] ArrayOps.GatherNd2D
2019-07-09 07:35:56.380377: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.380585: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.GatherNd2D (4 ms)
[ RUN      ] ArrayOps.GatherNd3D
2019-07-09 07:35:56.384072: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.384261: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.GatherNd3D (3 ms)
[ RUN      ] ArrayOps.OneHot1dNegAxis
2019-07-09 07:35:56.388744: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.389497: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.OneHot1dNegAxis (5 ms)
[ RUN      ] ArrayOps.OneHot1d
2019-07-09 07:35:56.393682: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.394376: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.OneHot1d (5 ms)
[ RUN      ] ArrayOps.OneHot2dNegAxis
2019-07-09 07:35:56.398694: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.399393: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.OneHot2dNegAxis (5 ms)
[ RUN      ] ArrayOps.OneHot2d
2019-07-09 07:35:56.403602: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.404301: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.OneHot2d (5 ms)
[ RUN      ] ArrayOps.OneHot3d
2019-07-09 07:35:56.408499: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.409253: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.OneHot3d (5 ms)
[ RUN      ] ArrayOps.OneHot3dNegAxis
2019-07-09 07:35:56.413751: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.414504: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.OneHot3dNegAxis (5 ms)
[ RUN      ] ArrayOps.Pad
2019-07-09 07:35:56.417951: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.418118: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.Pad (4 ms)
[ RUN      ] ArrayOps.PreventGradient
2019-07-09 07:35:56.421407: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.421588: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.425106: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.425348: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.428687: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.428875: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.431874: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.432023: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.PreventGradient (14 ms)
[ RUN      ] ArrayOps.QuantizeV2i8
2019-07-09 07:35:56.437594: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.438897: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.QuantizeV2i8 (7 ms)
[ RUN      ] ArrayOps.QuantizeV2u8SameRange
2019-07-09 07:35:56.444807: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.446152: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.QuantizeV2u8SameRange (7 ms)
[ RUN      ] ArrayOps.QuantizeV2u8DiffRange
2019-07-09 07:35:56.452125: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.453398: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.QuantizeV2u8DiffRange (8 ms)
[ RUN      ] ArrayOps.QuantizeAndDequantizeV2x8xtruextrue
2019-07-09 07:35:56.457594: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.458327: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.QuantizeAndDequantizeV2x8xtruextrue (4 ms)
[ RUN      ] ArrayOps.QuantizeAndDequantizeV2x8xtruexfalse
2019-07-09 07:35:56.462698: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.463441: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.QuantizeAndDequantizeV2x8xtruexfalse (5 ms)
[ RUN      ] ArrayOps.QuantizedConcat
2019-07-09 07:35:56.475313: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.477597: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.QuantizedConcat (15 ms)
[ RUN      ] ArrayOps.Rank
2019-07-09 07:35:56.481587: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.481767: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.Rank (4 ms)
[ RUN      ] ArrayOps.Shape2D
2019-07-09 07:35:56.485095: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.485268: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.Shape2D (3 ms)
[ RUN      ] ArrayOps.Shape3D
2019-07-09 07:35:56.488468: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.488611: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.Shape3D (4 ms)
[ RUN      ] ArrayOps.SizeOpAttrsChange
2019-07-09 07:35:56.491719: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.491862: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.494945: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.495093: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.498145: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.498291: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.501339: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.501486: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.504517: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.504665: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.507967: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.508184: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.SizeOpAttrsChange (19 ms)
[ RUN      ] ArrayOps.SizeOpDefault
2019-07-09 07:35:56.511582: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.511732: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.514892: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.515037: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.518069: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.518214: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.521965: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.522148: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.525312: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.525458: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.528878: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.529043: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.SizeOpDefault (21 ms)
[ RUN      ] ArrayOps.Slice
2019-07-09 07:35:56.532590: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.533351: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.Slice (4 ms)
[ RUN      ] ArrayOps.SpaceToDepthNHWC
2019-07-09 07:35:56.537140: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.537292: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.541112: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.541265: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.545963: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.546118: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.550011: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.550158: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.568495: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.568735: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.576525: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.576769: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.581905: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.582099: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.586665: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.586862: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.SpaceToDepthNHWC (54 ms)
[ RUN      ] ArrayOps.SpaceToDepthNCHW
2019-07-09 07:35:56.591090: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.592000: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.598953: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.599833: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.604565: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.605541: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.610660: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.611524: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.616417: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.617352: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.622671: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.624107: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.663558: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.698358: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.SpaceToDepthNCHW (119 ms)
[ RUN      ] ArrayOps.StridedSliceTest1
2019-07-09 07:35:56.715743: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.721185: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.StridedSliceTest1 (16 ms)
[ RUN      ] ArrayOps.SplitNegativeAxis
2019-07-09 07:35:56.726788: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.727032: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.SplitNegativeAxis (5 ms)
[ RUN      ] ArrayOps.SplitPositiveAxis
2019-07-09 07:35:56.731622: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.731812: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.SplitPositiveAxis (4 ms)
[ RUN      ] ArrayOps.SplitVNegSizeSplit
2019-07-09 07:35:56.736415: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.737885: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.SplitVNegSizeSplit (6 ms)
[ RUN      ] ArrayOps.SplitVNegativeAxis
2019-07-09 07:35:56.742615: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.744063: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.SplitVNegativeAxis (6 ms)
[ RUN      ] ArrayOps.SplitVPositiveSizeSplits
2019-07-09 07:35:56.748792: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.750212: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.SplitVPositiveSizeSplits (7 ms)
[ RUN      ] ArrayOps.SplitVZeroSizeSplit
2019-07-09 07:35:56.754192: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.755512: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.SplitVZeroSizeSplit (5 ms)
[ RUN      ] ArrayOps.SplitVZeroSizeNegSplit
2019-07-09 07:35:56.759683: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.761094: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.SplitVZeroSizeNegSplit (5 ms)
[ RUN      ] ArrayOps.Tile
2019-07-09 07:35:56.770274: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.770571: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.806732: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.807044: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.851102: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.851326: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.854836: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.855081: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.Tile (94 ms)
[ RUN      ] ArrayOps.Transpose
2019-07-09 07:35:56.859100: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.859346: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.Transpose (5 ms)
[ RUN      ] ArrayOps.TransposeConstant
2019-07-09 07:35:56.862926: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.863092: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.TransposeConstant (3 ms)
[ RUN      ] ArrayOps.Unpack
2019-07-09 07:35:56.867134: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.867302: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.872276: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.872480: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.876735: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.876977: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.Unpack (14 ms)
[ RUN      ] ArrayOps.ZerosLike
2019-07-09 07:35:56.880630: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.880811: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.ZerosLike (4 ms)
[----------] 45 tests from ArrayOps (690 ms total)

[----------] 6 tests from VariableTest
[ RUN      ] VariableTest.SmallGraph1
2019-07-09 07:35:56.882493: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.886707: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.892485: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.892994: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.893733: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.895133: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.897466: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] VariableTest.SmallGraph1 (16 ms)
[ RUN      ] VariableTest.SmallGraph2
2019-07-09 07:35:56.899072: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.903429: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.912027: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.912554: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.913311: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.915113: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.916428: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] VariableTest.SmallGraph2 (19 ms)
[ RUN      ] VariableTest.SmallGraph3
2019-07-09 07:35:56.918221: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.922958: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.928860: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.937613: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.938118: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.938880: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.940318: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.942798: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.945136: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] VariableTest.SmallGraph3 (29 ms)
[ RUN      ] VariableTest.SmallGraph4
2019-07-09 07:35:56.947751: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.954587: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.960731: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.967599: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.973019: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.973653: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.975151: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.976718: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.978680: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.979984: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.981358: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] VariableTest.SmallGraph4 (37 ms)
[ RUN      ] VariableTest.SmallGraph5
2019-07-09 07:35:56.983282: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.987041: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.992555: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.992941: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.993680: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.994675: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.996122: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] VariableTest.SmallGraph5 (14 ms)
[ RUN      ] VariableTest.SmallGraph6
2019-07-09 07:35:56.997576: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:57.001702: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:57.008172: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:57.008645: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:57.009439: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:57.011189: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:57.013020: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] VariableTest.SmallGraph6 (17 ms)
[----------] 6 tests from VariableTest (132 ms total)

[----------] Global test environment tear-down
[==========] 181 tests from 14 test cases ran. (2204 ms total)
[  PASSED  ] 181 tests.

  YOU HAVE 20 DISABLED TESTS
samhodge commented 5 years ago

How do I enable NGraph for the tests?

samhodge commented 5 years ago

Trying the model_level_tests now, also seems to be CPU only

samhodge commented 5 years ago

Looking at this: https://github.com/tensorflow/ngraph-bridge/blob/master/test/model_level_tests/README.md

How can PlaidML be specified?

samhodge commented 5 years ago

OK with the CPU back end everything is OK

(venv-tf-py3) kaos-new:wide_deep sam$ python wide_deep_test.py 
['CPU', 'INTERPRETER', 'PLAIDML', 'NOP']
WARNING: Logging before flag parsing goes to stderr.
W0715 07:20:37.756990 140736213103488 deprecation_wrapper.py:119] From /Users/sam/dev/models/official/utils/logging/hooks.py:26: The name tf.train.SessionRunHook is deprecated. Please use tf.estimator.SessionRunHook instead.

W0715 07:20:37.758661 140736213103488 deprecation_wrapper.py:119] From /Users/sam/dev/models/official/utils/logging/metric_hook.py:26: The name tf.train.LoggingTensorHook is deprecated. Please use tf.estimator.LoggingTensorHook instead.

W0715 07:20:37.758934 140736213103488 deprecation_wrapper.py:119] From wide_deep_test.py:30: The name tf.logging.set_verbosity is deprecated. Please use tf.compat.v1.logging.set_verbosity instead.

W0715 07:20:37.759047 140736213103488 deprecation_wrapper.py:119] From wide_deep_test.py:30: The name tf.logging.ERROR is deprecated. Please use tf.compat.v1.logging.ERROR instead.

Running tests under Python 3.6.5: /Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/bin/python
[ RUN      ] BaseTest.test_end_to_end_deep
Parsing /var/folders/wy/wxfdgdvn23zbw8q9mmv5q0br0000gq/T/wide_deep_testc1y2rubm/tmpdaldf10e/adult.data
2019-07-15 07:20:39.851392: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2019-07-15 07:20:39.922476: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:40.122278: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:40.156513: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:40.192457: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:40.224482: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:40.703927: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:40.838180: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:41.067843: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:41.448085: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
Parsing /var/folders/wy/wxfdgdvn23zbw8q9mmv5q0br0000gq/T/wide_deep_testc1y2rubm/tmpdaldf10e/adult.test
2019-07-15 07:20:42.873549: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:42.916773: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:42.975586: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:43.028438: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:43.089133: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:43.347070: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:43.586694: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
Results at epoch 1
------------------------------------------------------------
accuracy: 0.5
accuracy_baseline: 0.5
auc: 0.5
auc_precision_recall: 0.74999994
average_loss: 101.560555
global_step: 1
label/mean: 0.5
loss: 3046.8167
precision: 0.5
prediction/mean: 0.9999999
recall: 1.0
[       OK ] BaseTest.test_end_to_end_deep
[ RUN      ] BaseTest.test_end_to_end_wide
Parsing /var/folders/wy/wxfdgdvn23zbw8q9mmv5q0br0000gq/T/wide_deep_testc1y2rubm/tmpl54cnxel/adult.data
2019-07-15 07:20:45.746394: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:45.794006: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:45.840725: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:45.890018: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:45.937091: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:46.718895: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:46.902587: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:47.307760: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:47.907653: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
Parsing /var/folders/wy/wxfdgdvn23zbw8q9mmv5q0br0000gq/T/wide_deep_testc1y2rubm/tmpl54cnxel/adult.test
2019-07-15 07:20:49.688712: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:49.726541: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:49.789319: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:49.853821: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:49.930247: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:50.338941: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:50.701192: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
Results at epoch 1
------------------------------------------------------------
accuracy: 0.9
accuracy_baseline: 0.5
auc: 0.95777774
auc_precision_recall: 0.9399421
average_loss: 0.3969052
global_step: 1
label/mean: 0.5
loss: 11.907156
precision: 0.8333333
prediction/mean: 0.5281824
recall: 1.0
[       OK ] BaseTest.test_end_to_end_wide
[ RUN      ] BaseTest.test_end_to_end_wide_deep
Parsing /var/folders/wy/wxfdgdvn23zbw8q9mmv5q0br0000gq/T/wide_deep_testc1y2rubm/tmp3009_9xp/adult.data
2019-07-15 07:20:53.473607: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:53.571918: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:53.638035: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:53.705950: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:53.766851: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:54.874209: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:55.144226: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:55.715512: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:56.544005: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
Parsing /var/folders/wy/wxfdgdvn23zbw8q9mmv5q0br0000gq/T/wide_deep_testc1y2rubm/tmp3009_9xp/adult.test
2019-07-15 07:20:58.809262: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:58.859001: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:58.937965: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:59.007752: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:59.086718: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:59.529918: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:59.928616: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
Results at epoch 1
------------------------------------------------------------
accuracy: 0.53333336
accuracy_baseline: 0.5
auc: 0.39555556
auc_precision_recall: 0.5186549
average_loss: 2.0061855
global_step: 1
label/mean: 0.5
loss: 60.185566
precision: 0.6
prediction/mean: 0.40287504
recall: 0.2
[       OK ] BaseTest.test_end_to_end_wide_deep
[ RUN      ] BaseTest.test_input_fn
Parsing /var/folders/wy/wxfdgdvn23zbw8q9mmv5q0br0000gq/T/wide_deep_testc1y2rubm/tmp2z39vyv8/test.csv
2019-07-15 07:21:00.392122: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
[       OK ] BaseTest.test_input_fn
[ RUN      ] BaseTest.test_session
[       OK ] BaseTest.test_session
[ RUN      ] BaseTest.test_wide_deep_estimator_training
Parsing wide_deep_test.csv
2019-07-15 07:21:02.995744: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:03.094725: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:03.163777: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:03.234244: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:03.294491: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:04.408025: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:04.666948: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:05.231902: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
Parsing wide_deep_test.csv
2019-07-15 07:21:07.778304: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:07.833050: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:07.914027: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:07.983661: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:08.068007: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:08.505143: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:08.947185: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
Parsing wide_deep_test.csv
2019-07-15 07:21:11.502585: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:11.580673: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:11.653313: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:11.718896: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:11.783845: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:12.911954: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:13.172609: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:13.750041: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:14.580000: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
Parsing wide_deep_test.csv
2019-07-15 07:21:19.938322: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:19.990324: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:20.072449: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:20.143543: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:20.222115: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:20.680735: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:21.124922: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
wide_deep initial results: {'accuracy': 0.46666667, 'accuracy_baseline': 0.5, 'auc': 0.7022222, 'auc_precision_recall': 0.69362104, 'average_loss': 15.969666, 'label/mean': 0.5, 'loss': 15.969666, 'precision': 0.4814815, 'prediction/mean': 0.83395505, 'recall': 0.8666667, 'global_step': 1}
wide_deep final results: {'accuracy': 0.93333334, 'accuracy_baseline': 0.5, 'auc': 0.99999994, 'auc_precision_recall': 0.99999994, 'average_loss': 0.3471694, 'label/mean': 0.5, 'loss': 0.3471694, 'precision': 0.88235295, 'prediction/mean': 0.5397825, 'recall': 1.0, 'global_step': 1001}
[       OK ] BaseTest.test_wide_deep_estimator_training
----------------------------------------------------------------------
Ran 6 tests in 43.431s

OK

see:

from here:

(venv-tf-py3) kaos-new:wide_deep sam$ cat wide_deep_test.py 
# Copyright 2017 The TensorFlow Authors. All Rights Reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
#     http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
# ==============================================================================

from __future__ import absolute_import
from __future__ import division
from __future__ import print_function

import ngraph_bridge
print(ngraph_bridge.list_backends())
ngraph_bridge.set_backend('CPU')
import os

import tensorflow as tf  # pylint: disable=g-bad-import-order

from official.utils.testing import integration
from official.wide_deep import wide_deep

tf.logging.set_verbosity(tf.logging.ERROR)

TEST_INPUT = ('18,Self-emp-not-inc,987,Bachelors,12,Married-civ-spouse,abc,'
              'Husband,zyx,wvu,34,56,78,tsr,<=50K')

TEST_INPUT_VALUES = {
    'age': 18,
    'education_num': 12,
    'capital_gain': 34,
    'capital_loss': 56,
    'hours_per_week': 78,
    'education': 'Bachelors',
    'marital_status': 'Married-civ-spouse',
    'relationship': 'Husband',
    'workclass': 'Self-emp-not-inc',
    'occupation': 'abc',
}

TEST_CSV = os.path.join(os.path.dirname(__file__), 'wide_deep_test.csv')

class BaseTest(tf.test.TestCase):
  """Tests for Wide Deep model."""

  def setUp(self):
    # Create temporary CSV file
    self.temp_dir = self.get_temp_dir()
    self.input_csv = os.path.join(self.temp_dir, 'test.csv')
    with tf.gfile.Open(self.input_csv, 'w') as temp_csv:
      temp_csv.write(TEST_INPUT)

    with tf.gfile.Open(TEST_CSV, "r") as temp_csv:
      test_csv_contents = temp_csv.read()

    # Used for end-to-end tests.
    for fname in ['adult.data', 'adult.test']:
      with tf.gfile.Open(os.path.join(self.temp_dir, fname), 'w') as test_csv:
        test_csv.write(test_csv_contents)

  def test_input_fn(self):
    dataset = wide_deep.input_fn(self.input_csv, 1, False, 1)
    features, labels = dataset.make_one_shot_iterator().get_next()
    config = tf.ConfigProto()
    config_ngraph_enabled = ngraph_bridge.update_config(config)
    with tf.Session(config=config_ngraph_enabled) as sess:
      features, labels = sess.run((features, labels))

      # Compare the two features dictionaries.
      for key in TEST_INPUT_VALUES:
        self.assertTrue(key in features)
        self.assertEqual(len(features[key]), 1)
        feature_value = features[key][0]

        # Convert from bytes to string for Python 3.
        if isinstance(feature_value, bytes):
          feature_value = feature_value.decode()

        self.assertEqual(TEST_INPUT_VALUES[key], feature_value)

      self.assertFalse(labels)

  def build_and_test_estimator(self, model_type):
    """Ensure that model trains and minimizes loss."""
    model = wide_deep.build_estimator(self.temp_dir, model_type)

    # Train for 1 step to initialize model and evaluate initial loss
    def get_input_fn(num_epochs, shuffle, batch_size):
      def input_fn():
        return wide_deep.input_fn(
            TEST_CSV, num_epochs=num_epochs, shuffle=shuffle,
            batch_size=batch_size)
      return input_fn

    model.train(input_fn=get_input_fn(1, True, 1), steps=1)
    initial_results = model.evaluate(input_fn=get_input_fn(1, False, 1))

    # Train for 100 epochs at batch size 3 and evaluate final loss
    model.train(input_fn=get_input_fn(100, True, 3))
    final_results = model.evaluate(input_fn=get_input_fn(1, False, 1))

    print('%s initial results:' % model_type, initial_results)
    print('%s final results:' % model_type, final_results)

    # Ensure loss has decreased, while accuracy and both AUCs have increased.
    self.assertLess(final_results['loss'], initial_results['loss'])
    self.assertGreater(final_results['auc'], initial_results['auc'])
    self.assertGreater(final_results['auc_precision_recall'],
                       initial_results['auc_precision_recall'])
    self.assertGreater(final_results['accuracy'], initial_results['accuracy'])

  def test_wide_deep_estimator_training(self):
    self.build_and_test_estimator('wide_deep')

  def test_end_to_end_wide(self):
    integration.run_synthetic(
        main=wide_deep.main, tmp_root=self.get_temp_dir(), extra_flags=[
            '--data_dir', self.get_temp_dir(),
            '--model_type', 'wide',
        ],
        synth=False, max_train=None)

  def test_end_to_end_deep(self):
    integration.run_synthetic(
        main=wide_deep.main, tmp_root=self.get_temp_dir(), extra_flags=[
            '--data_dir', self.get_temp_dir(),
            '--model_type', 'deep',
        ],
        synth=False, max_train=None)

  def test_end_to_end_wide_deep(self):
    integration.run_synthetic(
        main=wide_deep.main, tmp_root=self.get_temp_dir(), extra_flags=[
            '--data_dir', self.get_temp_dir(),
            '--model_type', 'wide_deep',
        ],
        synth=False, max_train=None)

if __name__ == '__main__':
  tf.test.main()

see: https://github.com/tensorflow/models/tree/d640ab9cb1c06e7da39cca0399f14f8c6a54eb9c/official/wide_deep

But when I change a single line

ngraph_bridge.set_backend('CPU')

to

ngraph_bridge.set_backend('PLAIDML:0')

I get the following in the attached output.txt file output.txt

How can I diagnose what the issue is?

Gerzer commented 5 years ago

I'm having the same issue with the "compilation failed" error when using the PlaidML backend. Everything works fine with the CPU backend.

@samhodge: Did you ever find a solution?

Gerzer commented 5 years ago

Interestingly, I get a different error when switching from Metal to OpenCL:

2019-08-13 10:31:18.297856: W tensorflow/core/framework/op_kernel.cc:1502] OP_REQUIRES failed at sparse_to_dense_op.cc:92 : Invalid argument: Dimension -1892243770 must be >= 0
Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/client/session.py", line 1356, in _do_call
    return fn(*args)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/client/session.py", line 1341, in _run_fn
    options, feed_dict, fetch_list, target_list, run_metadata)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/client/session.py", line 1429, in _call_tf_sessionrun
    run_metadata)
tensorflow.python.framework.errors_impl.InvalidArgumentError: assertion failed: [Expected shape for Tensor english/rnn_stack/rnn/sequence_length:0 is ] [1] [ but saw shape: ] [1]
     [[{{node english/rnn_stack/rnn/Assert/Assert}}]]

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.6/bin/ludwig", line 11, in <module>
    load_entry_point('ludwig==0.2.1', 'console_scripts', 'ludwig')()
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/cli.py", line 108, in main
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/cli.py", line 64, in __init__
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/cli.py", line 69, in experiment
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/experiment.py", line 472, in cli
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/experiment.py", line 203, in experiment
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/train.py", line 311, in full_train
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/train.py", line 475, in train
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/models/model.py", line 537, in train
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/client/session.py", line 950, in run
    run_metadata_ptr)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/client/session.py", line 1173, in _run
    feed_dict_tensor, options, run_metadata)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/client/session.py", line 1350, in _do_run
    run_metadata)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/client/session.py", line 1370, in _do_call
    raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.InvalidArgumentError: assertion failed: [Expected shape for Tensor english/rnn_stack/rnn/sequence_length:0 is ] [1] [ but saw shape: ] [1]
     [[node english/rnn_stack/rnn/Assert/Assert (defined at /lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/models/modules/recurrent_modules.py:212) ]]

Original stack trace for 'english/rnn_stack/rnn/Assert/Assert':
  File "/bin/ludwig", line 11, in <module>
    load_entry_point('ludwig==0.2.1', 'console_scripts', 'ludwig')()
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/cli.py", line 108, in main
    CLI()
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/cli.py", line 64, in __init__
    getattr(self, args.command)()
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/cli.py", line 69, in experiment
    experiment.cli(sys.argv[2:])
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/experiment.py", line 472, in cli
    experiment(**vars(args))
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/experiment.py", line 203, in experiment
    **kwargs
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/train.py", line 311, in full_train
    debug=debug
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/train.py", line 456, in train
    debug=debug
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/models/model.py", line 113, in __init__
    **kwargs
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/models/model.py", line 163, in __build
    is_training=self.is_training
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/models/inputs.py", line 42, in build_inputs
    **kwargs)
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/models/inputs.py", line 69, in build_single_input
    **kwargs)
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/features/text_feature.py", line 219, in build_input
    is_training
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/features/sequence_feature.py", line 178, in build_sequence_input
    is_training=is_training
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/models/modules/sequence_encoders.py", line 1423, in __call__
    is_training=is_training
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/models/modules/recurrent_modules.py", line 212, in __call__
    dtype=tf.float32)
  File "/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/util/deprecation.py", line 324, in new_func
    return func(*args, **kwargs)
  File "/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/ops/rnn.py", line 694, in dynamic_rnn
    [_assert_has_shape(sequence_length, [batch_size])]):
  File "/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/ops/rnn.py", line 688, in _assert_has_shape
    " but saw shape: ", x_shape
  File "/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/util/tf_should_use.py", line 193, in wrapped
    return _add_should_use_warning(fn(*args, **kwargs))
  File "/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/ops/control_flow_ops.py", line 163, in Assert
    return gen_logging_ops._assert(condition, data, summarize, name="Assert")
  File "/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/ops/gen_logging_ops.py", line 74, in _assert
    name=name)
  File "/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/framework/op_def_library.py", line 788, in _apply_op_helper
    op_def=op_def)
  File "/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/util/deprecation.py", line 507, in new_func
    return func(*args, **kwargs)
  File "/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/framework/ops.py", line 3616, in create_op
    op_def=op_def)
  File "/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/framework/ops.py", line 2005, in __init__
    self._traceback = tf_stack.extract_stack()

(I'm using a library called Ludwig, which I modified myself to work on top of TensorFlow with nGraph.)

samhodge commented 5 years ago

I havent followed up for some time, I hope to put some time into this soon

Sam

jverce commented 5 years ago

Had a similar issue to @Gerzer's:

Traceback (most recent call last):
  File "/Users/jay/.pyenv/versions/plaidenv/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1356, in _do_call
    return fn(*args)
  File "/Users/jay/.pyenv/versions/plaidenv/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1341, in _run_fn
    options, feed_dict, fetch_list, target_list, run_metadata)
  File "/Users/jay/.pyenv/versions/plaidenv/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1429, in _call_tf_sessionrun
    run_metadata)
tensorflow.python.framework.errors_impl.InvalidArgumentError: assertion failed: [Expected shape for Tensor dynamic_seq2seq/encoder/rnn/sequence_length:0 is ] [1] [ but saw shape: ] [1]
     [[{{node dynamic_seq2seq/encoder/rnn/Assert/Assert}}]]
kenthinson commented 4 years ago

To answer the original question How to use the backend.

At the top of your NoteBook or python file before importing Tensorflow.

import ngraph_bridge
ngraph_bridge.set_backend('PLAIDML')

Then find import tensorflow as tf and add this code after it.

config = tf.ConfigProto()
config_ngraph_enabled = ngraph_bridge.update_config(config)
sess = tf.Session(config=config_ngraph_enabled)