search

TadasBaltrusaitis / OpenFace

OpenFace – a state-of-the art tool intended for facial landmark detection, head pose estimation, facial action unit recognition, and eye-gaze estimation.
Other
6.97k stars 1.85k forks source link

(FeatureExtraction:27300): GStreamer-PBUtils-CRITICAL **: 02:56:06.922: gst_missing_encoder_message_new: assertion 'gst_caps_is_fixed (encode_caps)' failed #1093

Open linhcentrio opened 1 month ago

linhcentrio commented 1 month ago

[root@aiclip-dfl gst-plugins-bad]# ./bin/FeatureExtraction -f ../samples/multi_face.avi -bash: ./bin/FeatureExtraction: No such file or directory [root@aiclip-dfl gst-plugins-bad]# cd /root/OpenFace/build [root@aiclip-dfl build]# ./bin/FeatureExtraction -f ../samples/multi_face.avi Could not find the HAAR face detector location Reading the landmark detector/tracker from: ./bin/model/main_ceclm_general.txt Reading the landmark detector module from: ./bin/model/cen_general.txt Reading the PDM module from: ./bin/model/pdms/In-the-wild_aligned_PDM_68.txt....Done Reading the Triangulations module from: ./bin/model/tris_68.txt....Done Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.25_of.dat....Done Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.35_of.dat....Done Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.50_of.dat....Done Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_1.00_of.dat....Done Reading part based module....left_eye_28 Reading the landmark detector/tracker from: ./bin/model/model_eye/main_clnf_synth_left.txt Reading the landmark detector module from: ./bin/model/model_eye/clnf_left_synth.txt Reading the PDM module from: ./bin/model/model_eye/pdms/pdm_28_l_eye_3D_closed.txt....Done Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/left_ccnf_patches_1.00_synthlid.txt....Done Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/left_ccnf_patches_1.50_synthlid.txt....Done Could not find the HAAR face detector location Done Reading part based module....right_eye_28 Reading the landmark detector/tracker from: ./bin/model/model_eye/main_clnf_synth_right.txt Reading the landmark detector module from: ./bin/model/model_eye/clnf_right_synth.txt Reading the PDM module from: ./bin/model/model_eye/pdms/pdm_28_eye_3D_closed.txt....Done Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/ccnf_patches_1.00_synthlid.txt....Done Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/ccnf_patches_1.50_synthlid.txt....Done Could not find the HAAR face detector location Done Reading the landmark validation module....Done Reading the AU analysis module from: ./bin/AU_predictors/main_dynamic_svms.txt Reading the AU predictors from: ./bin/AU_predictors/AU_all_best.txt... Done Reading the PDM from: ./bin/AU_predictors/In-the-wild_aligned_PDM_68.txt... Done Reading the triangulation from:./bin/AU_predictors/tris_68_full.txt... Done Attempting to read from file: ../samples/multi_face.avi

(FeatureExtraction:27300): GStreamer-CRITICAL **: 02:56:06.551: gst_query_set_position: assertion 'format == g_value_get_enum (gst_structure_id_get_value (s, GST_QUARK (FORMAT)))' failed Device or file opened Starting tracking Reading the MTCNN face detector from: ./bin/model/mtcnn_detector/MTCNN_detector.txt Reading the PNet module from: ./bin/model/mtcnn_detector/PNet.dat Reading the RNet module from: ./bin/model/mtcnn_detector/RNet.dat Reading the ONet module from: ./bin/model/mtcnn_detector/ONet.dat

(FeatureExtraction:27300): GStreamer-PBUtils-CRITICAL **: 02:56:06.922: gst_missing_encoder_message_new: assertion 'gst_caps_is_fixed (encode_caps)' failed

(FeatureExtraction:27300): GStreamer-CRITICAL **: 02:56:06.925: gst_element_post_message: assertion 'message != NULL' failed 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Closing output recorder Closing input reader Closed successfully Postprocessing the Action Unit predictions

linhcentrio commented 1 month ago

i run on almalinux 9 and my open cv: Video I/O: -- DC1394: YES (2.2.6) -- FFMPEG: NO -- avcodec: YES (57.107.100) -- avformat: YES (57.83.100) -- avutil: YES (55.78.100) -- swscale: YES (4.8.100) -- avresample: NO -- GStreamer: YES (1.22.1) -- v4l/v4l2: YES (linux/videodev2.h)

brmarkus commented 1 month ago

How have you installed OpenFace? I don't know "almalinux 9", have you experienced problems calling the installation-setup-script "install.sh"?

Are you able to playback the video file "../samples/multi_face.avi" on your system using gstreamer manually (just to check if the video-file is correct and complete, sometimes it contains HTML-text when downloading went wrong)?

linhcentrio commented 1 month ago

install.sh which only for ubuntu i can not run it on centos 8,9 same as almalinux (upgrade from centos 7) so i try many way but still has some issue with openface, pls help more

brmarkus commented 1 month ago

Looks like a gstreamer problem on your system, and especially with encoding (recording), maybe a missing codec library (and/or incompatible GPU).

Are you able to playback the video file manually (gstreamer, VLC, any media-player)?

Can you try to specify another output codec via command line parameter -oc <FOURCC_CODE> (see "https://github.com/TadasBaltrusaitis/OpenFace/wiki/Command-line-arguments")

Like

./bin/FeatureExtraction -f ../samples/multi_face.avi -oc MPEG
./bin/FeatureExtraction -f ../samples/multi_face.avi -oc X264
./bin/FeatureExtraction -f ../samples/multi_face.avi -oc mp4v
linhcentrio commented 1 month ago

there are steps i try to install openface on linux 9: sudo yum install gtk2-devel ffmpeg ffmpeg-devel sudo yum install tbb tbb-devel sudo yum install libjpeg-turbo-devel libpng-devel libtiff-devel sudo yum install python3-devel sudo yum install opencv opencv-devel ffmpeg ffmpeg-devel sudo yum install epel-release sudo yum update sudo yum install libtiff libtiff-devel

sudo yum install gstreamer1 gstreamer1-plugins-base gstreamer1-plugins-good gstreamer1-plugins-bad gstreamer1-plugins-ugly gstreamer1-libav gstreamer1-devel sudo yum install gstreamer1-plugins-good gstreamer1-plugins-base gstreamer1-plugins-ugly gstreamer1-devel

export PKG_CONFIG_PATH=/usr/lib/pkgconfig:/usr/local/lib/pkgconfig:$PKG_CONFIG_PATH export PKG_CONFIG_PATH=/opt/ffmpeg/lib/pkgconfig:$PKG_CONFIG_PATH

sudo yum install meson ninja-build pip3 install meson

Tải GStreamer core

cd /usr/local/src wget https://gstreamer.freedesktop.org/src/gstreamer/gstreamer-1.22.1.tar.xz tar -xf gstreamer-1.22.1.tar.xz cd gstreamer-1.22.1

Build và cài đặt bằng meson và ninja

meson build cd build ninja sudo ninja install

Plugins cơ bản

cd /usr/local/src wget https://gstreamer.freedesktop.org/src/gst-plugins-base/gst-plugins-base-1.22.1.tar.xz tar -xf gst-plugins-base-1.22.1.tar.xz cd gst-plugins-base-1.22.1

Build và cài đặt

meson build cd build ninja sudo ninja install

export PKG_CONFIG_PATH=/usr/local/lib/pkgconfig:$PKG_CONFIG_PATH

pkg-config --modversion gstreamer-video-1.0 pkg-config --modversion gstreamer-app-1.0 pkg-config --modversion gstreamer-audio-1.0 pkg-config --modversion gstreamer-pbutils-1.0

git clone https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad.git cd gst-plugins-bad meson build ninja -C build sudo ninja -C build install

pkg-config --modversion gstreamer-1.0

wget https://github.com/opencv/opencv/archive/4.1.0.zip unzip 4.1.0.zip cd opencv-4.1.0 mkdir build cd build cmake -DBUILD_TIFF=ON -DWITH_V4L=ON -DWITH_FFMPEG=ON -DWITH_GSTREAMER=ON -D CMAKE_BUILD_TYPE=RELEASE .. make -j$(nproc) sudo make install

git clone https://github.com/TadasBaltrusaitis/OpenFace.git cd OpenFace mkdir build cd build

cmake -D CMAKE_C_COMPILER=/usr/local/bin/gcc -D CMAKE_CXX_COMPILER=/usr/local/bin/g++ -D CMAKE_BUILD_TYPE=RELEASE .. make clean make -j$(nproc) sudo make install

linhcentrio commented 1 month ago

Looks like a gstreamer problem on your system, and especially with encoding (recording), maybe a missing codec library (and/or incompatible GPU).

Are you able to playback the video file manually (gstreamer, VLC, any media-player)?

Can you try to specify another output codec via command line parameter -oc <FOURCC_CODE> (see "https://github.com/TadasBaltrusaitis/OpenFace/wiki/Command-line-arguments")

Like

./bin/FeatureExtraction -f ../samples/multi_face.avi -oc MPEG
./bin/FeatureExtraction -f ../samples/multi_face.avi -oc X264
./bin/FeatureExtraction -f ../samples/multi_face.avi -oc mp4v

yeah i can run these cli on my linux 9, as log bellow:

(/home/SyncTalk/venv) [root@aiclip-dfl build]# ./bin/FeatureExtraction -f ../samples/multi_face.avi -oc MPEG Could not find the HAAR face detector location Reading the landmark detector/tracker from: ./bin/model/main_ceclm_general.txt Reading the landmark detector module from: ./bin/model/cen_general.txt Reading the PDM module from: ./bin/model/pdms/In-the-wild_aligned_PDM_68.txt....Done Reading the Triangulations module from: ./bin/model/tris_68.txt....Done Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.25_of.dat....Done Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.35_of.dat....Done Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.50_of.dat....Done Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_1.00_of.dat....Done Reading part based module....left_eye_28 Reading the landmark detector/tracker from: ./bin/model/model_eye/main_clnf_synth_left.txt Reading the landmark detector module from: ./bin/model/model_eye/clnf_left_synth.txt Reading the PDM module from: ./bin/model/model_eye/pdms/pdm_28_l_eye_3D_closed.txt....Done Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/left_ccnf_patches_1.00_synthlid.txt....Done Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/left_ccnf_patches_1.50_synthlid.txt....Done Could not find the HAAR face detector location Done Reading part based module....right_eye_28 Reading the landmark detector/tracker from: ./bin/model/model_eye/main_clnf_synth_right.txt Reading the landmark detector module from: ./bin/model/model_eye/clnf_right_synth.txt Reading the PDM module from: ./bin/model/model_eye/pdms/pdm_28_eye_3D_closed.txt....Done Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/ccnf_patches_1.00_synthlid.txt....Done Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/ccnf_patches_1.50_synthlid.txt....Done Could not find the HAAR face detector location Done Reading the landmark validation module....Done Reading the AU analysis module from: ./bin/AU_predictors/main_dynamic_svms.txt Reading the AU predictors from: ./bin/AU_predictors/AU_all_best.txt... Done Reading the PDM from: ./bin/AU_predictors/In-the-wild_aligned_PDM_68.txt... Done Reading the triangulation from:./bin/AU_predictors/tris_68_full.txt... Done Attempting to read from file: ../samples/multi_face.avi

(FeatureExtraction:61855): GStreamer-CRITICAL **: 04:05:14.962: gst_query_set_position: assertion 'format == g_value_get_enum (gst_structure_id_get_value (s, GST_QUARK (FORMAT)))' failed Device or file opened Starting tracking Reading the MTCNN face detector from: ./bin/model/mtcnn_detector/MTCNN_detector.txt Reading the PNet module from: ./bin/model/mtcnn_detector/PNet.dat Reading the RNet module from: ./bin/model/mtcnn_detector/RNet.dat Reading the ONet module from: ./bin/model/mtcnn_detector/ONet.dat

(FeatureExtraction:61855): GStreamer-PBUtils-CRITICAL **: 04:05:15.430: gst_missing_encoder_message_new: assertion 'gst_caps_is_fixed (encode_caps)' failed

(FeatureExtraction:61855): GStreamer-CRITICAL **: 04:05:15.430: gst_element_post_message: assertion 'message != NULL' failed 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Closing output recorder Closing input reader Closed successfully Postprocessing the Action Unit predictions (/home/SyncTalk/venv) [root@aiclip-dfl build]# ./bin/FeatureExtraction -f ../samples/multi_face.avi -oc X264 Could not find the HAAR face detector location Reading the landmark detector/tracker from: ./bin/model/main_ceclm_general.txt Reading the landmark detector module from: ./bin/model/cen_general.txt Reading the PDM module from: ./bin/model/pdms/In-the-wild_aligned_PDM_68.txt....Done Reading the Triangulations module from: ./bin/model/tris_68.txt....Done Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.25_of.dat....Done Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.35_of.dat....Done Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.50_of.dat....Done Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_1.00_of.dat....Done Reading part based module....left_eye_28 Reading the landmark detector/tracker from: ./bin/model/model_eye/main_clnf_synth_left.txt Reading the landmark detector module from: ./bin/model/model_eye/clnf_left_synth.txt Reading the PDM module from: ./bin/model/model_eye/pdms/pdm_28_l_eye_3D_closed.txt....Done Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/left_ccnf_patches_1.00_synthlid.txt....Done Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/left_ccnf_patches_1.50_synthlid.txt....Done Could not find the HAAR face detector location Done Reading part based module....right_eye_28 Reading the landmark detector/tracker from: ./bin/model/model_eye/main_clnf_synth_right.txt Reading the landmark detector module from: ./bin/model/model_eye/clnf_right_synth.txt Reading the PDM module from: ./bin/model/model_eye/pdms/pdm_28_eye_3D_closed.txt....Done Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/ccnf_patches_1.00_synthlid.txt....Done Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/ccnf_patches_1.50_synthlid.txt....Done Could not find the HAAR face detector location Done Reading the landmark validation module....Done Reading the AU analysis module from: ./bin/AU_predictors/main_dynamic_svms.txt Reading the AU predictors from: ./bin/AU_predictors/AU_all_best.txt... Done Reading the PDM from: ./bin/AU_predictors/In-the-wild_aligned_PDM_68.txt... Done Reading the triangulation from:./bin/AU_predictors/tris_68_full.txt... Done Attempting to read from file: ../samples/multi_face.avi

(FeatureExtraction:61905): GStreamer-CRITICAL **: 04:05:45.922: gst_query_set_position: assertion 'format == g_value_get_enum (gst_structure_id_get_value (s, GST_QUARK (FORMAT)))' failed Device or file opened Starting tracking Reading the MTCNN face detector from: ./bin/model/mtcnn_detector/MTCNN_detector.txt Reading the PNet module from: ./bin/model/mtcnn_detector/PNet.dat Reading the RNet module from: ./bin/model/mtcnn_detector/RNet.dat Reading the ONet module from: ./bin/model/mtcnn_detector/ONet.dat

(FeatureExtraction:61905): GStreamer-PBUtils-CRITICAL **: 04:05:46.416: gst_missing_encoder_message_new: assertion 'gst_caps_is_fixed (encode_caps)' failed

(FeatureExtraction:61905): GStreamer-CRITICAL **: 04:05:46.416: gst_element_post_message: assertion 'message != NULL' failed 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Closing output recorder Closing input reader Closed successfully Postprocessing the Action Unit predictions (/home/SyncTalk/venv) [root@aiclip-dfl build]# ./bin/FeatureExtraction -f ../samples/multi_face.avi -oc mp4v Could not find the HAAR face detector location Reading the landmark detector/tracker from: ./bin/model/main_ceclm_general.txt Reading the landmark detector module from: ./bin/model/cen_general.txt Reading the PDM module from: ./bin/model/pdms/In-the-wild_aligned_PDM_68.txt....Done Reading the Triangulations module from: ./bin/model/tris_68.txt....Done Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.25_of.dat....Done Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.35_of.dat....Done Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.50_of.dat....Done Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_1.00_of.dat....Done Reading part based module....left_eye_28 Reading the landmark detector/tracker from: ./bin/model/model_eye/main_clnf_synth_left.txt Reading the landmark detector module from: ./bin/model/model_eye/clnf_left_synth.txt Reading the PDM module from: ./bin/model/model_eye/pdms/pdm_28_l_eye_3D_closed.txt....Done Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/left_ccnf_patches_1.00_synthlid.txt....Done Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/left_ccnf_patches_1.50_synthlid.txt....Done Could not find the HAAR face detector location Done Reading part based module....right_eye_28 Reading the landmark detector/tracker from: ./bin/model/model_eye/main_clnf_synth_right.txt Reading the landmark detector module from: ./bin/model/model_eye/clnf_right_synth.txt Reading the PDM module from: ./bin/model/model_eye/pdms/pdm_28_eye_3D_closed.txt....Done Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/ccnf_patches_1.00_synthlid.txt....Done Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/ccnf_patches_1.50_synthlid.txt....Done Could not find the HAAR face detector location Done Reading the landmark validation module....Done Reading the AU analysis module from: ./bin/AU_predictors/main_dynamic_svms.txt Reading the AU predictors from: ./bin/AU_predictors/AU_all_best.txt... Done Reading the PDM from: ./bin/AU_predictors/In-the-wild_aligned_PDM_68.txt... Done Reading the triangulation from:./bin/AU_predictors/tris_68_full.txt... Done Attempting to read from file: ../samples/multi_face.avi

(FeatureExtraction:61957): GStreamer-CRITICAL **: 04:06:14.857: gst_query_set_position: assertion 'format == g_value_get_enum (gst_structure_id_get_value (s, GST_QUARK (FORMAT)))' failed Device or file opened Starting tracking Reading the MTCNN face detector from: ./bin/model/mtcnn_detector/MTCNN_detector.txt Reading the PNet module from: ./bin/model/mtcnn_detector/PNet.dat Reading the RNet module from: ./bin/model/mtcnn_detector/RNet.dat Reading the ONet module from: ./bin/model/mtcnn_detector/ONet.dat

(FeatureExtraction:61957): GStreamer-PBUtils-CRITICAL **: 04:06:15.344: gst_missing_encoder_message_new: assertion 'gst_caps_is_fixed (encode_caps)' failed

(FeatureExtraction:61957): GStreamer-CRITICAL **: 04:06:15.344: gst_element_post_message: assertion 'message != NULL' failed 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Closing output recorder Closing input reader Closed successfully Postprocessing the Action Unit predictions

linhcentrio commented 1 month ago

although log inform GStreamer-CRITICAL but still complete process: 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Closing output recorder Closing input reader Closed successfully

linhcentrio commented 1 month ago

when i run:

GST_DEBUG=3 ./bin/FeatureExtraction -f ../samples/multi_face.avi -oc MPEG

i got: (/home/SyncTalk/venv) [root@aiclip-dfl build]# GST_DEBUG=3 ./bin/FeatureExtraction -f ../samples/multi_face.avi -oc MPEG Could not find the HAAR face detector location Reading the landmark detector/tracker from: ./bin/model/main_ceclm_general.txt Reading the landmark detector module from: ./bin/model/cen_general.txt Reading the PDM module from: ./bin/model/pdms/In-the-wild_aligned_PDM_68.txt....Done Reading the Triangulations module from: ./bin/model/tris_68.txt....Done Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.25_of.dat....Done Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.35_of.dat....Done Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.50_of.dat....Done Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_1.00_of.dat....Done Reading part based module....left_eye_28 Reading the landmark detector/tracker from: ./bin/model/model_eye/main_clnf_synth_left.txt Reading the landmark detector module from: ./bin/model/model_eye/clnf_left_synth.txt Reading the PDM module from: ./bin/model/model_eye/pdms/pdm_28_l_eye_3D_closed.txt....Done Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/left_ccnf_patches_1.00_synthlid.txt....Done Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/left_ccnf_patches_1.50_synthlid.txt....Done Could not find the HAAR face detector location Done Reading part based module....right_eye_28 Reading the landmark detector/tracker from: ./bin/model/model_eye/main_clnf_synth_right.txt Reading the landmark detector module from: ./bin/model/model_eye/clnf_right_synth.txt Reading the PDM module from: ./bin/model/model_eye/pdms/pdm_28_eye_3D_closed.txt....Done Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/ccnf_patches_1.00_synthlid.txt....Done Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/ccnf_patches_1.50_synthlid.txt....Done Could not find the HAAR face detector location Done Reading the landmark validation module....Done Reading the AU analysis module from: ./bin/AU_predictors/main_dynamic_svms.txt Reading the AU predictors from: ./bin/AU_predictors/AU_all_best.txt... Done Reading the PDM from: ./bin/AU_predictors/In-the-wild_aligned_PDM_68.txt... Done Reading the triangulation from:./bin/AU_predictors/tris_68_full.txt... Done Attempting to read from file: ../samples/multi_face.avi 0:00:00.022579105 62011 0xb8370b0 WARN basesrc gstbasesrc.c:3693:gst_base_src_start_complete: pad not activated yet 0:00:00.023060296 62011 0xb8370b0 WARN basesrc gstbasesrc.c:3693:gst_base_src_start_complete: pad not activated yet

(FeatureExtraction:62011): GStreamer-CRITICAL **: 04:10:26.709: gst_query_set_position: assertion 'format == g_value_get_enum (gst_structure_id_get_value (s, GST_QUARK (FORMAT)))' failed Device or file opened Starting tracking Reading the MTCNN face detector from: ./bin/model/mtcnn_detector/MTCNN_detector.txt Reading the PNet module from: ./bin/model/mtcnn_detector/PNet.dat Reading the RNet module from: ./bin/model/mtcnn_detector/RNet.dat Reading the ONet module from: ./bin/model/mtcnn_detector/ONet.dat 0:00:00.627616468 62011 0xb8370b0 ERROR GST_PIPELINE gst/parse/grammar.y:570:gst_parse_element_make: no element "processed" 0:00:00.627684367 62011 0xb8370b0 ERROR GST_PIPELINE gst/parse/grammar.y:1331:priv_gst_parse_yyparse: no source element for URI "/multi_face.avi" 0:00:00.638951027 62011 0x7fd8f80015c0 FIXME default gstutils.c:4031:gst_pad_create_stream_id_internal: Creating random stream-id, consider implementing a deterministic way of creating a stream-id 0:00:00.639345912 62011 0x7fd8f80015c0 WARN GST_CAPS gstpad.c:3240:gst_pad_query_accept_caps_default: caps: video/x-raw, format=(string)BGR, width=(int)640, height=(int)480, framerate=(fraction)30/1 were not compatible with: video/mpeg, mpegversion=(int)4, systemstream=(boolean)false; video/x-divx, divxversion=(int)[ 4, 5 ] 0:00:00.639531790 62011 0x7fd8f80015c0 WARN GST_CAPS gstpad.c:3240:gst_pad_query_accept_caps_default: caps: video/x-raw, format=(string)BGR, width=(int)640, height=(int)480, framerate=(fraction)30/1 were not compatible with: video/mpeg, mpegversion=(int)4, systemstream=(boolean)false; video/x-divx, divxversion=(int)[ 4, 5 ] 0:00:00.639813792 62011 0x7fd8f80018d0 WARN GST_CAPS gstpad.c:3240:gst_pad_query_accept_caps_default: caps: video/x-raw, format=(string)BGR, width=(int)640, height=(int)480, framerate=(fraction)30/1 were not compatible with: video/mpeg, mpegversion=(int)4, systemstream=(boolean)false; video/x-divx, divxversion=(int)[ 4, 5 ] 0:00:00.717397984 62011 0x7fd8f80018d0 ERROR encodebasebin gstencodebasebin.c:1274:_post_missing_plugin_message: Couldn't create encoder with preset (NULL) and preset name (NULL) for format video/x-divx, divxversion=(int)4, framerate=(fraction)[ 0/1, 2147483647/1 ], width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ]

(FeatureExtraction:62011): GStreamer-PBUtils-CRITICAL **: 04:10:27.183: gst_missing_encoder_message_new: assertion 'gst_caps_is_fixed (encode_caps)' failed

(FeatureExtraction:62011): GStreamer-CRITICAL **: 04:10:27.183: gst_element_post_message: assertion 'message != NULL' failed 0:00:00.717637175 62011 0x7fd8f80018d0 WARN encodebasebin gstencodebasebin.c:1283:_post_missing_plugin_message: error: Couldn't create encoder for format video/x-divx, divxversion=(int)4, framerate=(fraction)[ 0/1, 2147483647/1 ], width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ] 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Closing output recorder Closing input reader Closed successfully Postprocessing the Action Unit predictions

linhcentrio commented 1 month ago

image this is out put of openface

brmarkus commented 1 month ago

hmm, ok, so the application is working?

linhcentrio commented 1 month ago

hmm, ok, so the application is working?

no i'm not sure, i need file au.csv and open with excel i see the content off it: is this allright? image

brmarkus commented 1 month ago

The table looks good.

Have a closer look into "https://github.com/TadasBaltrusaitis/OpenFace/wiki/Output-Format" to study the columns and values and meanings.