search

FaceAR / OpenFaceIOS

OpenFace is get from https://github.com/TadasBaltrusaitis/OpenFace, a state-of-the art open source tool intended for facial landmark detection, head pose estimation, facial action unit recognition, and eye-gaze estimation. And I create an ios project. Delete Dlib,TBB,Boost. Only use OpenCV .
GNU General Public License v3.0
502 stars 135 forks source link

LandmarkDetectorModel.cpp:1109 error #1

Closed virut26 closed 6 years ago

virut26 commented 8 years ago

when I run this program and press start button there is error occur in LandmarkDetectorModel.cpp Line 1109 Line 1109 code is float dx = dxs.at(i); float dy = dys.at(i);

After that this program is stop running. How can I resolve it?

KeeganRen commented 8 years ago

@virut26 I'm very sorry so long to reply to you, because of the recent busy, I will solve this problem as soon as possible. Can you list you "Build Phases"->"Copy Bundle Resources".

stanchiang commented 8 years ago

i'm having the same issue. i've attached my "Build Phases"->"Copy Bundle Resources".

screen shot 2016-08-06 at 8 21 10 pm
KeeganRen commented 8 years ago

@stanchiang Can you list your Iphone model, And I need to reproduce this error!

stanchiang commented 8 years ago

i'm running it on an iPhone 6s plus. That's the only device I tested it on. Also, it randomly worked one time. But it crashed the rest of the time, tested it like 7 times in total. I couldn't find a pattern.

and here's my console log output. idk if that helps

model_location = /var/containers/Bundle/Application/4602BAE8-DE04-4F88-9D9B-E76FAD95010B/FaceAR_SDK_IOS_OpenFace_RunFull.app/model/main_clnf_general.txt
face_detector_location = /var/containers/Bundle/Application/4602BAE8-DE04-4F88-9D9B-E76FAD95010B/FaceAR_SDK_IOS_OpenFace_RunFull.app/classifiers/haarcascade_frontalface_alt.xml
Reading the CLNF landmark detector/tracker from: /var/containers/Bundle/Application/4602BAE8-DE04-4F88-9D9B-E76FAD95010B/FaceAR_SDK_IOS_OpenFace_RunFull.app/model/main_clnf_general.txt
Reading the landmark detector module from: /var/containers/Bundle/Application/4602BAE8-DE04-4F88-9D9B-E76FAD95010B/FaceAR_SDK_IOS_OpenFace_RunFull.app/model/clnf_general.txt
clnf_location = /var/containers/Bundle/Application/4602BAE8-DE04-4F88-9D9B-E76FAD95010B/FaceAR_SDK_IOS_OpenFace_RunFull.app/model/clnf_general.txt
Reading the PDM module from: /var/containers/Bundle/Application/4602BAE8-DE04-4F88-9D9B-E76FAD95010B/FaceAR_SDK_IOS_OpenFace_RunFull.app/model/pdms/In-the-wild_aligned_PDM_68.txt....Done
Reading the Triangulations module from: /var/containers/Bundle/Application/4602BAE8-DE04-4F88-9D9B-E76FAD95010B/FaceAR_SDK_IOS_OpenFace_RunFull.app/model/tris_68.txt....Done
Reading the intensity CCNF patch experts from: /var/containers/Bundle/Application/4602BAE8-DE04-4F88-9D9B-E76FAD95010B/FaceAR_SDK_IOS_OpenFace_RunFull.app/model/patch_experts/ccnf_patches_0.25_general.txt....Done
Reading the intensity CCNF patch experts from: /var/containers/Bundle/Application/4602BAE8-DE04-4F88-9D9B-E76FAD95010B/FaceAR_SDK_IOS_OpenFace_RunFull.app/model/patch_experts/ccnf_patches_0.35_general.txt....Done
Reading the intensity CCNF patch experts from: /var/containers/Bundle/Application/4602BAE8-DE04-4F88-9D9B-E76FAD95010B/FaceAR_SDK_IOS_OpenFace_RunFull.app/model/patch_experts/ccnf_patches_0.5_general.txt....Done
Reading part based module....inner
Reading the CLNF landmark detector/tracker from: /var/containers/Bundle/Application/4602BAE8-DE04-4F88-9D9B-E76FAD95010B/FaceAR_SDK_IOS_OpenFace_RunFull.app/model/model_inner/main_clnf_inner.txt
Reading the landmark detector module from: /var/containers/Bundle/Application/4602BAE8-DE04-4F88-9D9B-E76FAD95010B/FaceAR_SDK_IOS_OpenFace_RunFull.app/model/model_inner/clnf_inner.txt
clnf_location = /var/containers/Bundle/Application/4602BAE8-DE04-4F88-9D9B-E76FAD95010B/FaceAR_SDK_IOS_OpenFace_RunFull.app/model/model_inner/clnf_inner.txt
Reading the PDM module from: /var/containers/Bundle/Application/4602BAE8-DE04-4F88-9D9B-E76FAD95010B/FaceAR_SDK_IOS_OpenFace_RunFull.app/model/model_inner/pdms/pdm_51_inner.txt....Done
Reading the intensity CCNF patch experts from: /var/containers/Bundle/Application/4602BAE8-DE04-4F88-9D9B-E76FAD95010B/FaceAR_SDK_IOS_OpenFace_RunFull.app/model/model_inner/patch_experts/ccnf_patches_1.00_inner.txt....Done
Done
Reading part based module....left_eye_28
Reading the CLNF landmark detector/tracker from: /var/containers/Bundle/Application/4602BAE8-DE04-4F88-9D9B-E76FAD95010B/FaceAR_SDK_IOS_OpenFace_RunFull.app/model/model_eye/main_clnf_synth_left.txt
Reading the landmark detector module from: /var/containers/Bundle/Application/4602BAE8-DE04-4F88-9D9B-E76FAD95010B/FaceAR_SDK_IOS_OpenFace_RunFull.app/model/model_eye/clnf_left_synth.txt
clnf_location = /var/containers/Bundle/Application/4602BAE8-DE04-4F88-9D9B-E76FAD95010B/FaceAR_SDK_IOS_OpenFace_RunFull.app/model/model_eye/clnf_left_synth.txt
Reading the PDM module from: /var/containers/Bundle/Application/4602BAE8-DE04-4F88-9D9B-E76FAD95010B/FaceAR_SDK_IOS_OpenFace_RunFull.app/model/model_eye/pdms/pdm_28_l_eye_3D_closed.txt....Done
Reading the intensity CCNF patch experts from: /var/containers/Bundle/Application/4602BAE8-DE04-4F88-9D9B-E76FAD95010B/FaceAR_SDK_IOS_OpenFace_RunFull.app/model/model_eye/patch_experts/left_ccnf_patches_1.00_synth_lid_.txt....Done
Reading the intensity CCNF patch experts from: /var/containers/Bundle/Application/4602BAE8-DE04-4F88-9D9B-E76FAD95010B/FaceAR_SDK_IOS_OpenFace_RunFull.app/model/model_eye/patch_experts/left_ccnf_patches_1.50_synth_lid_.txt....Done
Done
Reading part based module....right_eye_28
Reading the CLNF landmark detector/tracker from: /var/containers/Bundle/Application/4602BAE8-DE04-4F88-9D9B-E76FAD95010B/FaceAR_SDK_IOS_OpenFace_RunFull.app/model/model_eye/main_clnf_synth_right.txt
Reading the landmark detector module from: /var/containers/Bundle/Application/4602BAE8-DE04-4F88-9D9B-E76FAD95010B/FaceAR_SDK_IOS_OpenFace_RunFull.app/model/model_eye/clnf_right_synth.txt
clnf_location = /var/containers/Bundle/Application/4602BAE8-DE04-4F88-9D9B-E76FAD95010B/FaceAR_SDK_IOS_OpenFace_RunFull.app/model/model_eye/clnf_right_synth.txt
Reading the PDM module from: /var/containers/Bundle/Application/4602BAE8-DE04-4F88-9D9B-E76FAD95010B/FaceAR_SDK_IOS_OpenFace_RunFull.app/model/model_eye/pdms/pdm_28_eye_3D_closed.txt....Done
Reading the intensity CCNF patch experts from: /var/containers/Bundle/Application/4602BAE8-DE04-4F88-9D9B-E76FAD95010B/FaceAR_SDK_IOS_OpenFace_RunFull.app/model/model_eye/patch_experts/ccnf_patches_1.00_synth_lid_.txt....Done
Reading the intensity CCNF patch experts from: /var/containers/Bundle/Application/4602BAE8-DE04-4F88-9D9B-E76FAD95010B/FaceAR_SDK_IOS_OpenFace_RunFull.app/model/model_eye/patch_experts/ccnf_patches_1.50_synth_lid_.txt....Done
Done
Reading the landmark validation module....Done
2016-08-08 20:03:17.414 FaceAR_SDK_IOS_OpenFace_RunFull[5408:1556667] camera available: YES
2016-08-08 20:03:17.416 FaceAR_SDK_IOS_OpenFace_RunFull[5408:1556667] deviceOrientationDidChange: 0
2016-08-08 20:03:17.417 FaceAR_SDK_IOS_OpenFace_RunFull[5408:1556667] deviceOrientationDidChange: 1
2016-08-08 20:03:17.425 FaceAR_SDK_IOS_OpenFace_RunFull[5408:1556667] deviceOrientationDidChange: 5
2016-08-08 20:03:17.552 FaceAR_SDK_IOS_OpenFace_RunFull[5408:1556667] deviceOrientationDidChange: 1
2016-08-08 20:03:19.285 FaceAR_SDK_IOS_OpenFace_RunFull[5408:1556667] deviceOrientationDidChange: 4
2016-08-08 20:03:21.282 FaceAR_SDK_IOS_OpenFace_RunFull[5408:1556667] deviceOrientationDidChange: 1
2016-08-08 20:03:22.322 FaceAR_SDK_IOS_OpenFace_RunFull[5408:1556667] [Camera] device connected? YES
2016-08-08 20:03:22.322 FaceAR_SDK_IOS_OpenFace_RunFull[5408:1556667] [Camera] device position back
2016-08-08 20:03:22.330 FaceAR_SDK_IOS_OpenFace_RunFull[5408:1556667] WARNING: -[<AVCaptureConnection: 0x56d599c0> isVideoMinFrameDurationSupported] is deprecated.  Please use AVCaptureDevice activeFormat.videoSupportedFrameRateRanges
2016-08-08 20:03:22.330 FaceAR_SDK_IOS_OpenFace_RunFull[5408:1556667] WARNING: -[<AVCaptureConnection: 0x56d599c0> setVideoMinFrameDuration:] is deprecated.  Please use AVCaptureDevice setActiveVideoMinFrameDuration
2016-08-08 20:03:22.330 FaceAR_SDK_IOS_OpenFace_RunFull[5408:1556667] WARNING: -[<AVCaptureConnection: 0x56d599c0> isVideoMaxFrameDurationSupported] is deprecated.  Please use AVCaptureDevice activeFormat.videoSupportedFrameRateRanges
2016-08-08 20:03:22.331 FaceAR_SDK_IOS_OpenFace_RunFull[5408:1556667] WARNING: -[<AVCaptureConnection: 0x56d599c0> setVideoMaxFrameDuration:] is deprecated.  Please use AVCaptureDevice setActiveVideoMaxFrameDuration
2016-08-08 20:03:22.333 FaceAR_SDK_IOS_OpenFace_RunFull[5408:1556667] layout preview layer
2016-08-08 20:03:22.334 FaceAR_SDK_IOS_OpenFace_RunFull[5408:1556667] [Camera] created AVCaptureVideoDataOutput at 30 FPS
KeeganRen commented 8 years ago

@stanchiang, Did you clean you project, and rebuild it. and It's the best way to create a project by your self. I git clone this project and occur this problem, Project clean & rebuild, this error is going .

whateverx commented 8 years ago

Try this for a fast fix

   if(patch_experts.visibilities[scale][view_id].at<int>(i,0) == 0 || dxs.dims == 0 )
        {
            continue;
        }
        float dx = dxs.at<float>(i);
        float dy = dys.at<float>(i);
stanchiang commented 8 years ago

thanks that did the trick!