search

Tachionstrahl / SignLanguageRecognition

Real-time Recognition of german sign language (DGS) with MediaPipe
https://www.hs-mainz.de
Apache License 2.0
135 stars 33 forks source link

running demo on CPU #7

Open ishaghodgaonkar opened 3 years ago

ishaghodgaonkar commented 3 years ago

Hello, thanks for the great work on this repo! I understand that the repository doesn't currently support CPU operations. I am getting this error when running the demo commands in the README:

I20201111 20:41:01.626775 480495040 demo_run_graph_main.cc:53] Initialize the calculator graph. E20201111 20:41:01.632501 480495040 demo_run_graph_main.cc:146] Failed to run the graph: ValidatedGraphConfig Initialization failed. SignLangPredictionCalculator::GetContract failed to validate: For output streams ValidatePacketTypeSet failed: Failed to get tag "" index 0 Tag "TEXT" index 0 was not expected.

I would like to get this working on my end, would you be able to let me know roughly what changes should be made and where to make it functional?

Thanks!

ishaghodgaonkar commented 3 years ago

Actually never mind! I did get it to work on CPU for file processing and live demo. I can make a pull request soon unless you have already started implementing this.

Any ideas as to why it is slow/freezes? Where should I start looking to try and fix this issue?

Thanks so much!

Tachionstrahl commented 3 years ago

Hi Isha, thanks for submitting your issue. Actually we do not work on a CPU version, simply because of the issue you're faced with. We know that running on CPU is pretty slow. We assume the processing of face and hand recognition simultaneously in combination with the downstream prediction of signs is not performant on CPU. Maybe it's possible to develop a faster graph for the CPU variant.