search

intel / ai-reference-models

Intel® AI Reference Models: contains Intel optimizations for running deep learning workloads on Intel® Xeon® Scalable processors and Intel® Data Center GPUs
Apache License 2.0
674 stars 220 forks source link

cannot run ssd_resnet34 int8 model with intel-tensorflow 2.5.0 #91

Open Zongru-Wen opened 3 years ago

Zongru-Wen commented 3 years ago

Whe I ues intel-tensorflow==2.5.0 to run SSD_ResNet34 model for inference, it will get an error:

Traceback (most recent call last):
  File "/home/support/miniconda3/envs/vdms_streamer/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1375, in _do_call
    return fn(*args)
  File "/home/support/miniconda3/envs/vdms_streamer/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1360, in _run_fn
    target_list, run_metadata)
  File "/home/support/miniconda3/envs/vdms_streamer/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1453, in _call_tf_sessionrun
    run_metadata)
tensorflow.python.framework.errors_impl.InternalError: Missing 0-th output from {{node v/cg/resnet34_backbone/conv1/conv2d/Conv2D_eightbit_requantize}}

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "draft.py", line 53, in <module>
    results = sess.run(output_tensors, {input_tensor: image})
  File "/home/support/miniconda3/envs/vdms_streamer/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 968, in run
    run_metadata_ptr)
  File "/home/support/miniconda3/envs/vdms_streamer/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1191, in _run
    feed_dict_tensor, options, run_metadata)
  File "/home/support/miniconda3/envs/vdms_streamer/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1369, in _do_run
    run_metadata)
  File "/home/support/miniconda3/envs/vdms_streamer/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1394, in _do_call
    raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.InternalError: Missing 0-th output from node v/cg/resnet34_backbone/conv1/conv2d/Conv2D_eightbit_requantize (defined at draft.py:21)

Then I downgrade the intel-tensorflow to 2.4.0, problem solved.

sramakintel commented 6 months ago

@Zongru-Wen can you try our latest intel optimizations for SSD-ResNet34 by following links here: https://www.intel.com/content/www/us/en/developer/articles/containers/cpu-reference-model-containers.html ?