openvinotoolkit / open_model_zoo

Pre-trained Deep Learning models and demos (high quality and extremely fast)
https://docs.openvino.ai/latest/model_zoo.html
Apache License 2.0
4.1k stars 1.37k forks source link

Smart Classroom Demo issue #1821

Closed allenwsh82 closed 3 years ago

allenwsh82 commented 4 years ago

Hello Experts,

Anyone encounter this issue before when I tried to run the smartclass room demo ?

[ INFO ] InferenceEngine: 00007FFFFD6E4390 [ INFO ] Parsing input parameters [ INFO ] Reading video 'classroom.mp4' [ INFO ] Loading Inference Engine [ INFO ] Device info: CPU MKLDNNPlugin version ......... 2.1 Build ........... 2020.4.0-359-21e092122f4-releases/2020/4

[ ERROR ] Check 'shape_size(get_input_shape(0)) == shape_size(output_shape)' failed at C:\j\workspace\private-ci\ie\build-windows-icc2018\b\repos\openvino\ngraph\src\ngraph\op\reshape.cpp:290: While validating node 'v1::Reshape Reshape_187891(Softmax_187890[0]:f32{3249,8}, Constant_187705[0]:i64{3}) -> (f32{1,3249,2})': Requested output shape Shape{1, 3249, 2} is incompatible with input shape Shape{3249, 8}

vladimir-dudnik commented 4 years ago

@allenwsh82 it seems model IR not corresponds to OpenVINO runtime. If you use OpenVINO 2020.4 runtime then you should not use model from 2021.1 release.

allenwsh82 commented 4 years ago

Hi Vladimir-Dudnik,

I am using IR file for OpenVINO 2020 release and some how I didn't see the error messages already but nothing happen, i guess it is not playing the .mp4 file, no pop out of the video windows, seems weird....

C:\Users\allensen\Documents\Intel\OpenVINO\omz_demos_build\intel64\Release>smart_classroom_demo.exe -i classroom.mp4 -m_act person-detection-action-recognition-0006.xml -m_fd face-detection-retail-0004.xml -m_lm landmarks-regression-retail-0009.xml -m_reid face-reidentification-retail-0095.xml -fg faces_gallery.json [ INFO ] InferenceEngine: 00007FFFFE094390 [ INFO ] Parsing input parameters [ INFO ] Reading video 'classroom.mp4' [ INFO ] Loading Inference Engine [ INFO ] Device info: CPU MKLDNNPlugin version ......... 2.1 Build ........... 2020.4.0-359-21e092122f4-releases/2020/4

C:\Users\allensen\Documents\Intel\OpenVINO\omz_demos_build\intel64\Release>

vladimir-dudnik commented 4 years ago

strange how it happens that ngraph related issue comes out without any changes. If you can't playback video file on windows it might be related to absence of required media codecs. You may need to download ffmpeg DLLs for opencv, see this thread on OpenVINO forum

allenwsh82 commented 4 years ago

Hello Vladimir-Dudnik,

Thanks for the recommendation and I had downloaded ffmpeg DLL for OpenCV previously. One thing I notice, when I use the same classroom.mp4 video with another Interactive_Face_Detetion example, it is working perfectly.

So I am wondering if this is related to smart_classroom_demo.exe only?

![Uploading Interactive_Face_Detection_Video.PNG…]()

allenwsh82 commented 4 years ago

Hello Vladimir-Dudnik,

Same results even I tried on diff machine in OpenVINO 2021, any thoughts, no issue running other demos.

Thanks

vladimir-dudnik commented 3 years ago

@allenwsh82 I do not have issue to run smart class room demo with OpenVINO 2021.2, which was just released, using parameters below: smart_classroom_demo.exe -i classroom.mp4 -m_act person-detection-action-recognition-0005.xml -m_fd face-detection-retail-0004.xml -m_lm landmarks-regression-retail-0009.xml -m_reid face-recognition-mobilefacenet-arcface.xml

smart_classroom_screenshot

But, when I change action recognition model to person-detection-action-recognition-0006.xml demo reports error: [ ERROR ] The number of specified actions and the number of actions predicted by the Person/Action Detection Retail model must match

This model recognize 6 actions vs 4 recognized by person-detection-action-recognition-0005, so you need to specify additional option to demo: -student_ac "sitting,writing,raising hand,standing,turned around,lie on the desk" to make it work.

vladimir-dudnik commented 3 years ago

@allenwsh82 do you have additional questions?

allenwsh82 commented 3 years ago

Hello Vladimir,

No more questions from my side.

Thanks for the help and advise

vladimir-dudnik commented 3 years ago

thanks, so I'll close this