search

modelbox-ai / modelbox

A high performance, high expansion, easy to use framework for AI application. 为AI应用的开发者提供一套统一的高性能、易用的编程框架，快速基于AI全栈服务、开发跨端边云的AI行业应用，支持GPU，NPU加速。
https://modelbox-ai.com
Apache License 2.0
133 stars 39 forks source link

表情识别demo 部署失败 #318

Open luoyangustc opened 1 year ago

luoyangustc commented 1 year ago

按照文档https://modelbox-ai.com/modelbox-book/cases/emotion-detection.html进行了表情识别的样例的实践，在开发环境中通过打包应用，生产了一个deb安装包和一个tar包；然后将deb文件和tar包文件拷贝到modelbox/modelbox-runtime-libtorch_1.9.1-cuda_10.2-ubuntu-x86_64:latest此镜像启动的容器内进行部署，部署步骤如下： 1、dpkg -i modelbox-application-1.0.0-Linux-emotion.deb 2、tar -xzvf modelbox-application-1.0.0-Linux.tar.gz 3、modelbox-tool -verbose INFO flow -run /opt/modelbox/application/emotion/graph/emotion.toml 结果在执行3时报错： [2022-11-08 06:29:15,497][ INFO][ flow.cc:97 ] run flow /opt/modelbox/application/emotion/graph/emotion.toml [2022-11-08 06:29:15,500][ INFO][ driver.cc:152 ] wait for subprocess 67 process finished [2022-11-08 06:29:15,974][ INFO][ driver.cc:61 ] scan process log: [2022-11-08 06:29:15.500][ INFO][ driver.cc:889 ] Scan dir: /opt/modelbox/application/emotion/flowunit [2022-11-08 06:29:15.500][ INFO][ driver.cc:889 ] Scan dir: /usr/local/lib [2022-11-08 06:29:15.506][ WARN][ driver.cc:1112] /usr/local/lib/libmodelbox-common-cpu-iam_auth.so : dlsym DriverDescription failed, /usr/local/lib/libmodelbox-common-cpu-iam_auth.so: undefined symbol: DriverDescription [2022-11-08 06:29:15.509][ WARN][ driver.cc:1112] /usr/local/lib/libmodelbox-drivers-common-filerequester.so.1.0.0 : dlsym DriverDescription failed, /usr/local/lib/libmodelbox-drivers-common-filerequester.so.1.0.0: undefined symbol: DriverDescription [2022-11-08 06:29:15.510][ WARN][ driver.cc:1112] /usr/local/lib/libmodelbox-drivers-common-fuse.so.1.0.0 : dlsym DriverDescription failed, /usr/local/lib/libmodelbox-drivers-common-fuse.so.1.0.0: undefined symbol: DriverDescription [2022-11-08 06:29:15.560][ WARN][ driver.cc:1112] /usr/local/lib/libmodelbox-unit-cpu-obs_client.so : dlsym DriverDescription failed, /usr/local/lib/libmodelbox-unit-cpu-obs_client.so: undefined symbol: DriverDescription [2022-11-08 06:29:15.576][ WARN][ driver.cc:1097] /usr/local/lib/libmodelbox-unit-cpu-python.so.1.0.0 : dlopen failed, libpython3.7m.so.1.0: cannot open shared object file: No such file or directory [2022-11-08 06:29:15,976][ INFO][ driver.cc:764 ] Gather scan info success, drivers count 45 [2022-11-08 06:29:15,976][ INFO][ driver.cc:1010] begin scan virtual drivers [2022-11-08 06:29:15,978][ INFO][virtualdriver_inference.cc:80 ] Add virtual driver /opt/modelbox/application/emotion/flowunit/face_detect/face_detect.toml success [2022-11-08 06:29:15,981][ INFO][virtualdriver_inference.cc:80 ] Add virtual driver /opt/modelbox/application/emotion/flowunit/emotion_infer/emotion_infer.toml success [2022-11-08 06:29:15,985][ WARN][ driver.cc:1045] virtual driver init failed, code: Not found, errmsg: can not find python flowunit [2022-11-08 06:29:15,986][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /opt/modelbox/application/emotion/flowunit/draw_emotion/draw_emotion.toml success [2022-11-08 06:29:15,987][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /opt/modelbox/application/emotion/flowunit/face_post/face_post.toml success [2022-11-08 06:29:15,988][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /opt/modelbox/application/emotion/flowunit/collapse_emotion/collapse_emotion.toml success [2022-11-08 06:29:15,989][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /opt/modelbox/application/emotion/flowunit/custom_resize/custom_resize.toml success [2022-11-08 06:29:15,990][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /opt/modelbox/application/emotion/flowunit/expand_box/expand_box.toml success [2022-11-08 06:29:15,999][ INFO][ driver.cc:1012] end scan virtual drivers [2022-11-08 06:29:16,346][ WARN][virtualdriverpython.cc:308 ] the key group type is empty, so classify it into Undefined. [2022-11-08 06:29:16,346][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, and uppercase the first character. [2022-11-08 06:29:16,346][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http. [2022-11-08 06:29:16,347][ WARN][virtualdriverpython.cc:308 ] the key group type is empty, so classify it into Undefined. [2022-11-08 06:29:16,347][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, and uppercase the first character. [2022-11-08 06:29:16,347][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http. [2022-11-08 06:29:16,348][ WARN][virtualdriverpython.cc:308 ] the key group type is empty, so classify it into Undefined. [2022-11-08 06:29:16,348][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, and uppercase the first character. [2022-11-08 06:29:16,348][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http. [2022-11-08 06:29:16,348][ WARN][virtualdriverpython.cc:308 ] the key group type is empty, so classify it into Undefined. [2022-11-08 06:29:16,348][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, and uppercase the first character. [2022-11-08 06:29:16,348][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http. [2022-11-08 06:29:16,349][ WARN][virtualdriverpython.cc:308 ] the key group type is empty, so classify it into Undefined. [2022-11-08 06:29:16,349][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, and uppercase the first character. [2022-11-08 06:29:16,349][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http. [2022-11-08 06:29:16,352][ INFO][ graph_manager.cc:353 ] graph.format : graphviz [2022-11-08 06:29:16,353][ INFO][ graph.cc:116 ] Build graph name:emotion_detection, id:faa75409-0052-417e-856c-81735f04d805 [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : collapse_emotion [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : confidence [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : predicts [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_data [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : custom_resize [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_image [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_image [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : draw_emotion [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_emotion [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_face [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_data [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : emotion_infer [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : input [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : confidence [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : predicts [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : expand_box [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_data [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : roi_image [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : face_detect [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : input [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_cls [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_conf [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_loc [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : face_mean [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_data [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_data [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : face_normalize [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_data [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_data [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : face_post [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_cls [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_conf [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_image [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_loc [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : has_face [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : no_face [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : face_resize [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_image [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_image [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : face_transpose [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_image [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_image [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : image_transpose [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_image [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_image [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : mean [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_data [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_data [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : normalize [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_data [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_data [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : video_input [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_video_url [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : videodecoder [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_video_packet [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_video_frame [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : videodemuxer [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_video_url [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_video_packet [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : videoencoder [2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_video_frame [2022-11-08 06:29:16,353][ INFO][ graph.cc:641 ] begin build node collapse_emotion [2022-11-08 06:29:16,354][ WARN][virtualdriverpython.cc:308 ] the key group type is empty, so classify it into Undefined. [2022-11-08 06:29:16,354][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, and uppercase the first character. [2022-11-08 06:29:16,354][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http. [2022-11-08 06:29:16,354][ WARN][flowunit_manager.cc:342 ] CreateFlowUnit: collapse_emotion failed, code: Not found, errmsg: not found flowunit collapse_emotion [2022-11-08 06:29:16,354][ERROR][ graph.cc:644 ] code: Not found, errmsg: create flowunit 'collapse_emotion' failed. [2022-11-08 06:29:16,354][ERROR][ flow.cc:537 ] build graph failed, Not found, build graph failed, please check graph config. -> create flowunit 'collapse_emotion' failed. -> not found flowunit collapse_emotion [2022-11-08 06:29:16,354][ERROR][ flow.cc:106 ] build flow failed, Not found, build graph failed, please check graph config. -> create flowunit 'collapse_emotion' failed. -> not found flowunit collapse_emotion

想知道是什么原因，该如何成功部署这个服务？谢谢！

luoyangustc commented 1 year ago

另我在editor的UI界面 点击调试：

image

body 和 url 该填什么，感觉模版没有渲染出来

tau233 commented 1 year ago

报错说明： 这个报错是说collapse_emotion功能单元找不到，可以检查下collapse_emotion.toml和对应的python代码，路径、类名等是否匹配等

调试说明： 表情识别demo用的是开发镜像里的测试视频文件，在graph/emotion.toml配置的输入输出： video_input[type=flowunit, flowunit=video_input, device=cpu, source_url="/opt/modelbox/demo/video/emotion_test_video.mp4"] videoencoder[type=flowunit, flowunit=video_encoder, device=cpu, encoder=mpeg4, format=mp4, default_dest_url="/tmp/emotion_detection_result.mp4"] 可以先在开发镜像中调试运行。由于runtime镜像中没有测试视频文件，用该配置部署到runtime镜像中无法正确运行

其他的建议： deb安装包和tar包只用安装一个就可以了

pymumu commented 1 year ago

这个log显示加载python相关的动态库失效了

[2022-11-08 06:29:15.576][ WARN][ driver.cc:1097] /usr/local/lib/libmodelbox-unit-cpu-python.so.1.0.0 : dlopen failed, libpython3.7m.so.1.0: cannot open shared object file: No such file or directory

确认下镜像是不是用的我们发布的，还有里面的modelbox程序是否有自己替换过？

luoyangustc commented 1 year ago

这个log显示加载python相关的动态库失效了

[2022-11-08 06:29:15.576][ WARN][ driver.cc:1097] /usr/local/lib/libmodelbox-unit-cpu-python.so.1.0.0 : dlopen failed, libpython3.7m.so.1.0: cannot open shared object file: No such file or directory

确认下镜像是不是用的我们发布的，还有里面的modelbox程序是否有自己替换过？

确认拉取的是你们官方镜像， image， 没有改过modelbox的程序！

luoyangustc commented 1 year ago

报错说明： 这个报错是说collapse_emotion功能单元找不到，可以检查下collapse_emotion.toml和对应的python代码，路径、类名等是否匹配等 这个是匹配的； 调试说明： 表情识别demo用的是开发镜像里的测试视频文件，在graph/emotion.toml配置的输入输出： video_input[type=flowunit, flowunit=video_input, device=cpu, source_url="/opt/modelbox/demo/video/emotion_test_video.mp4"] videoencoder[type=flowunit, flowunit=video_encoder, device=cpu, encoder=mpeg4, format=mp4, default_dest_url="/tmp/emotion_detection_result.mp4"] 可以先在开发镜像中调试运行。由于runtime镜像中没有测试视频文件，用该配置部署到runtime镜像中无法正确运行 嗯嗯，但是我在看法镜像的/tmp文件夹下没有发现emotion_detection_result.mp4文件，UI任务管理里 image 是任务正在执行中，这个不是一个http的web服务，这个执行中的状态代表什么意思， 2、通过UII创建项目时，会在项目根目录里也有modexbox和modelbox-manager的二进制，这个与/usr/local/usr/local/bin 目录下的有什么区别？我看md5不一样。 其他的建议： deb安装包和tar包只用安装一个就可以了 OK

tau233 commented 1 year ago

1、运行中表示modelbox进程还在运行，任务可能已经结束，详细情况可以查看/var/log/modelbox/目录下的日志 2、项目根目录下的是脚本文件，会调用/usr/local/bin下的二进制

luoyangustc commented 1 year ago

1、应该看项目目录下的日志文件吧，/var 下是manager的日志 2、我自己modelbox-tool flow -run confile 是可以完成表情识别的任务，但是通过U I点击运行后，发现任务失败，看日志 [2022-11-08 13:08:45,289][ INFO][ editor_plugin.cc:661 ] template_dir:/usr/local/share/modelbox/project-template/project [2022-11-08 13:08:45,295][ INFO][ driver.cc:152 ] wait for subprocess 1948 process finished [2022-11-08 13:08:45,779][ INFO][ driver.cc:61 ] scan process log: [2022-11-08 13:08:45.297][ INFO][ driver.cc:889 ] Scan dir: /opt/modelbox/application/emotion/flowunit [2022-11-08 13:08:45.297][ WARN][ driver.cc:892 ] scan /opt/modelbox/application/emotion/flowunit failed, Fault, lstat /opt/modelbox/application/emotion/flowunit failed, No such file or directory [2022-11-08 13:08:45.297][ INFO][ driver.cc:889 ] Scan dir: /home/emotion/src/flowunit [2022-11-08 13:08:45.298][ INFO][ driver.cc:889 ] Scan dir: /usr/local/lib [2022-11-08 13:08:45.304][ WARN][ driver.cc:1112] /usr/local/lib/libmodelbox-common-cpu-iam_auth.so : dlsym DriverDescription failed, /usr/local/lib/libmodelbox-common-cpu-iam_auth.so: undefined symbol: DriverDescription [2022-11-08 13:08:45.306][ WARN][ driver.cc:1112] /usr/local/lib/libmodelbox-drivers-common-filerequester.so.1.0.0 : dlsym DriverDescription failed, /usr/local/lib/libmodelbox-drivers-common-filerequester.so.1.0.0: undefined symbol: DriverDescription [2022-11-08 13:08:45.307][ WARN][ driver.cc:1112] /usr/local/lib/libmodelbox-drivers-common-fuse.so.1.0.0 : dlsym DriverDescription failed, /usr/local/lib/libmodelbox-drivers-common-fuse.so.1.0.0: undefined symbol: DriverDescription [2022-11-08 13:08:45.356][ WARN][ driver.cc:1112] /usr/local/lib/libmodelbox-unit-cpu-obs_client.so : dlsym DriverDescription failed, /usr/local/lib/libmodelbox-unit-cpu-obs_client.so: undefined symbol: DriverDescription [2022-11-08 13:08:45,781][ INFO][ driver.cc:764 ] Gather scan info success, drivers count 46 [2022-11-08 13:08:45,781][ INFO][ driver.cc:1010] begin scan virtual drivers [2022-11-08 13:08:45,781][ WARN][virtual_driver.cc:44 ] Scan /opt/modelbox/application/emotion/flowunit failed, code: Not found, errmsg: list directory: /opt/modelbox/application/emotion/flowunit/.toml failed. [2022-11-08 13:08:45,782][ INFO][virtualdriver_inference.cc:80 ] Add virtual driver /home/emotion/src/flowunit/face_detect/face_detect.toml success [2022-11-08 13:08:45,785][ INFO][virtualdriver_inference.cc:80 ] Add virtual driver /home/emotion/src/flowunit/emotion_infer/emotion_infer.toml success [2022-11-08 13:08:45,789][ WARN][virtual_driver.cc:44 ] Scan /opt/modelbox/application/emotion/flowunit failed, code: Not found, errmsg: No such file or directory [2022-11-08 13:08:45,791][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /home/emotion/src/flowunit/draw_emotion/draw_emotion.toml success [2022-11-08 13:08:45,792][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /home/emotion/src/flowunit/face_post/face_post.toml success [2022-11-08 13:08:45,793][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /home/emotion/src/flowunit/collapse_emotion/collapse_emotion.toml success [2022-11-08 13:08:45,794][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /home/emotion/src/flowunit/custom_resize/custom_resize.toml success [2022-11-08 13:08:45,795][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /home/emotion/src/flowunit/expand_box/expand_box.toml success [2022-11-08 13:08:45,797][ WARN][virtual_driver.cc:44 ] Scan /opt/modelbox/application/emotion/flowunit failed, code: Not found, errmsg: list directory: /opt/modelbox/application/emotion/flowunit/.toml failed. [2022-11-08 13:08:45,804][ INFO][ driver.cc:1012] end scan virtual drivers [2022-11-08 13:08:46,268][ WARN][virtualdriverpython.cc:308 ] the key group type is empty, so classify it into Undefined. [2022-11-08 13:08:46,268][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, and uppercase the first character. [2022-11-08 13:08:46,268][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http. [2022-11-08 13:08:46,269][ WARN][virtualdriverpython.cc:308 ] the key group type is empty, so classify it into Undefined. [2022-11-08 13:08:46,269][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, and uppercase the first character. [2022-11-08 13:08:46,269][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http. [2022-11-08 13:08:46,270][ WARN][virtualdriverpython.cc:308 ] the key group type is empty, so classify it into Undefined. [2022-11-08 13:08:46,270][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, and uppercase the first character. [2022-11-08 13:08:46,270][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http. [2022-11-08 13:08:46,270][ WARN][virtualdriverpython.cc:308 ] the key group type is empty, so classify it into Undefined. [2022-11-08 13:08:46,270][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, and uppercase the first character. [2022-11-08 13:08:46,270][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http. [2022-11-08 13:08:46,271][ WARN][virtualdriverpython.cc:308 ] the key group type is empty, so classify it into Undefined. [2022-11-08 13:08:46,271][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, and uppercase the first character. [2022-11-08 13:08:46,271][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http. [2022-11-08 13:08:46,289][ INFO][ editor_plugin.cc:405 ] loading project: /home/emotion [2022-11-08 13:08:46,289][ INFO][ editor_plugin.cc:573 ] exec: /usr/local/bin/modelbox-tool template -project -getname "/home/emotion" [2022-11-08 13:08:46,373][ INFO][ editor_plugin.cc:405 ] loading project: /home/emotion [2022-11-08 13:08:46,373][ INFO][ editor_plugin.cc:573 ] exec: /usr/local/bin/modelbox-tool template -project -getname "/home/emotion" [2022-11-08 13:08:47,492][ERROR][ driver.cc:836 ] lstat /opt/modelbox/application/emotion/flowunit failed, errno:No such file or directory [2022-11-08 13:08:47,495][ INFO][ driver.cc:152 ] wait for subprocess 1960 process finished [2022-11-08 13:08:47,687][ INFO][ driver.cc:61 ] scan process log: [2022-11-08 13:08:47.497][ INFO][ driver.cc:889 ] Scan dir: /opt/modelbox/application/emotion/flowunit [2022-11-08 13:08:47.497][ WARN][ driver.cc:892 ] scan /opt/modelbox/application/emotion/flowunit failed, Fault, lstat /opt/modelbox/application/emotion/flowunit failed, No such file or directory [2022-11-08 13:08:47.498][ INFO][ driver.cc:889 ] Scan dir: /home/emotion/src/flowunit [2022-11-08 13:08:47.498][ INFO][ driver.cc:889 ] Scan dir: /usr/local/lib [2022-11-08 13:08:47.502][ WARN][ driver.cc:1112] /usr/local/lib/libmodelbox-common-cpu-iam_auth.so : dlsym DriverDescription failed, /usr/local/lib/libmodelbox-common-cpu-iam_auth.so: undefined symbol: DriverDescription [2022-11-08 13:08:47.504][ WARN][ driver.cc:1112] /usr/local/lib/libmodelbox-drivers-common-filerequester.so.1.0.0 : dlsym DriverDescription failed, /usr/local/lib/libmodelbox-drivers-common-filerequester.so.1.0.0: undefined symbol: DriverDescription [2022-11-08 13:08:47.505][ WARN][ driver.cc:1112] /usr/local/lib/libmodelbox-drivers-common-fuse.so.1.0.0 : dlsym DriverDescription failed, /usr/local/lib/libmodelbox-drivers-common-fuse.so.1.0.0: undefined symbol: DriverDescription [2022-11-08 13:08:47.552][ WARN][ driver.cc:1112] /usr/local/lib/libmodelbox-unit-cpu-obs_client.so : dlsym DriverDescription failed, /usr/local/lib/libmodelbox-unit-cpu-obs_client.so: undefined symbol: DriverDescription [2022-11-08 13:08:47,688][ INFO][ driver.cc:764 ] Gather scan info success, drivers count 46 [2022-11-08 13:08:47,688][ INFO][ driver.cc:1010] begin scan virtual drivers [2022-11-08 13:08:47,688][ WARN][virtual_driver.cc:44 ] Scan /opt/modelbox/application/emotion/flowunit failed, code: Not found, errmsg: list directory: /opt/modelbox/application/emotion/flowunit/.toml failed. [2022-11-08 13:08:47,690][ INFO][virtualdriver_inference.cc:80 ] Add virtual driver /home/emotion/src/flowunit/face_detect/face_detect.toml success [2022-11-08 13:08:47,692][ INFO][virtualdriver_inference.cc:80 ] Add virtual driver /home/emotion/src/flowunit/emotion_infer/emotion_infer.toml success [2022-11-08 13:08:47,696][ WARN][virtual_driver.cc:44 ] Scan /opt/modelbox/application/emotion/flowunit failed, code: Not found, errmsg: No such file or directory [2022-11-08 13:08:47,697][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /home/emotion/src/flowunit/draw_emotion/draw_emotion.toml success [2022-11-08 13:08:47,698][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /home/emotion/src/flowunit/face_post/face_post.toml success [2022-11-08 13:08:47,699][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /home/emotion/src/flowunit/collapse_emotion/collapse_emotion.toml success [2022-11-08 13:08:47,700][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /home/emotion/src/flowunit/custom_resize/custom_resize.toml success [2022-11-08 13:08:47,701][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /home/emotion/src/flowunit/expand_box/expand_box.toml success [2022-11-08 13:08:47,703][ WARN][virtual_driver.cc:44 ] Scan /opt/modelbox/application/emotion/flowunit failed, code: Not found, errmsg: list directory: /opt/modelbox/application/emotion/flowunit/.toml failed. [2022-11-08 13:08:47,710][ INFO][ driver.cc:1012] end scan virtual drivers [2022-11-08 13:08:47,777][ WARN][virtualdriverpython.cc:308 ] the key group type is empty, so classify it into Undefined. [2022-11-08 13:08:47,777][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, and uppercase the first character. [2022-11-08 13:08:47,777][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http. [2022-11-08 13:08:47,777][ WARN][virtualdriverpython.cc:308 ] the key group type is empty, so classify it into Undefined. [2022-11-08 13:08:47,777][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, and uppercase the first character. [2022-11-08 13:08:47,777][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http. [2022-11-08 13:08:47,778][ WARN][virtualdriverpython.cc:308 ] the key group type is empty, so classify it into Undefined. [2022-11-08 13:08:47,778][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, and uppercase the first character. [2022-11-08 13:08:47,778][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http. [2022-11-08 13:08:47,779][ WARN][virtualdriverpython.cc:308 ] the key group type is empty, so classify it into Undefined. [2022-11-08 13:08:47,779][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, and uppercase the first character. [2022-11-08 13:08:47,779][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http. [2022-11-08 13:08:47,779][ WARN][virtualdriverpython.cc:308 ] the key group type is empty, so classify it into Undefined. [2022-11-08 13:08:47,780][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, and uppercase the first character. [2022-11-08 13:08:47,780][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http. [2022-11-08 13:08:47,782][ INFO][ graph_manager.cc:353 ] graph.format : graphviz [2022-11-08 13:08:47,783][ INFO][ graph.cc:116 ] Build graph name:emotion_detection, id:70e63e76-37b9-4ec8-a777-9a5d8e18438f [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : collapse_emotion [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : confidence [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : predicts [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_data [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : custom_resize [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_image [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_image [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : draw_emotion [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_emotion [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_face [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_data [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : emotion_infer [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : input [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : confidence [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : predicts [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : expand_box [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_data [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : roi_image [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : face_detect [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : input [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_cls [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_conf [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_loc [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : face_mean [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_data [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_data [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : face_normalize [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_data [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_data [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : face_post [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_cls [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_conf [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_image [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_loc [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : has_face [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : no_face [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : face_resize [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_image [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_image [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : face_transpose [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_image [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_image [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : image_transpose [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_image [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_image [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : mean [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_data [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_data [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : normalize [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_data [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_data [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : video_input [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_video_url [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : videodecoder [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_video_packet [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_video_frame [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : videodemuxer [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_video_url [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_video_packet [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : videoencoder [2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_video_frame [2022-11-08 13:08:47,783][ INFO][ graph.cc:641 ] begin build node collapse_emotion [2022-11-08 13:08:47,784][ WARN][virtualdriverpython.cc:308 ] the key group type is empty, so classify it into Undefined. [2022-11-08 13:08:47,784][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, and uppercase the first character. [2022-11-08 13:08:47,784][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http. [2022-11-08 13:08:47,784][ INFO][ graph.cc:647 ] build node collapse_emotion success [2022-11-08 13:08:47,784][ INFO][ graph.cc:641 ] begin build node custom_resize [2022-11-08 13:08:47,785][ WARN][virtualdriverpython.cc:308 ] the key group type is empty, so classify it into Undefined. [2022-11-08 13:08:47,785][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, and uppercase the first character. [2022-11-08 13:08:47,785][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http. [2022-11-08 13:08:47,785][ INFO][ graph.cc:647 ] build node custom_resize success [2022-11-08 13:08:47,785][ INFO][ graph.cc:641 ] begin build node draw_emotion [2022-11-08 13:08:47,786][ WARN][virtualdriverpython.cc:308 ] the key group type is empty, so classify it into Undefined. [2022-11-08 13:08:47,786][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, and uppercase the first character. [2022-11-08 13:08:47,786][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http. [2022-11-08 13:08:47,786][ INFO][ graph.cc:647 ] build node draw_emotion success [2022-11-08 13:08:47,786][ INFO][ graph.cc:641 ] begin build node emotion_infer [2022-11-08 13:09:03,422][ INFO][ graph.cc:647 ] build node emotion_infer success [2022-11-08 13:09:03,422][ INFO][ graph.cc:641 ] begin build node expand_box [2022-11-08 13:09:03,423][ WARN][virtualdriverpython.cc:308 ] the key group type is empty, so classify it into Undefined. [2022-11-08 13:09:03,423][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, and uppercase the first character. [2022-11-08 13:09:03,423][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http. [2022-11-08 13:09:03,423][ INFO][ graph.cc:647 ] build node expand_box success [2022-11-08 13:09:03,423][ INFO][ graph.cc:641 ] begin build node face_detect [2022-11-08 13:09:03,426][ INFO][ graph.cc:647 ] build node face_detect success [2022-11-08 13:09:03,426][ INFO][ graph.cc:641 ] begin build node face_mean [2022-11-08 13:09:03,426][ INFO][ graph.cc:647 ] build node face_mean success [2022-11-08 13:09:03,426][ INFO][ graph.cc:641 ] begin build node face_normalize [2022-11-08 13:09:03,426][ INFO][ graph.cc:647 ] build node face_normalize success [2022-11-08 13:09:03,426][ INFO][ graph.cc:641 ] begin build node face_post [2022-11-08 13:09:03,427][ WARN][virtualdriverpython.cc:308 ] the key group type is empty, so classify it into Undefined. [2022-11-08 13:09:03,427][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, and uppercase the first character. [2022-11-08 13:09:03,427][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http. [2022-11-08 13:09:03,427][ INFO][ graph.cc:647 ] build node face_post success [2022-11-08 13:09:03,427][ INFO][ graph.cc:641 ] begin build node face_resize [2022-11-08 13:09:03,427][ INFO][ graph.cc:647 ] build node face_resize success [2022-11-08 13:09:03,427][ INFO][ graph.cc:641 ] begin build node face_transpose [2022-11-08 13:09:03,428][ INFO][ graph.cc:647 ] build node face_transpose success [2022-11-08 13:09:03,428][ INFO][ graph.cc:641 ] begin build node image_transpose [2022-11-08 13:09:03,428][ INFO][ graph.cc:647 ] build node image_transpose success [2022-11-08 13:09:03,428][ INFO][ graph.cc:641 ] begin build node mean [2022-11-08 13:09:03,428][ INFO][ graph.cc:647 ] build node mean success [2022-11-08 13:09:03,428][ INFO][ graph.cc:641 ] begin build node normalize [2022-11-08 13:09:03,428][ INFO][ graph.cc:647 ] build node normalize success [2022-11-08 13:09:03,428][ INFO][ graph.cc:641 ] begin build node video_input [2022-11-08 13:09:03,428][ INFO][ graph.cc:647 ] build node video_input success [2022-11-08 13:09:03,428][ INFO][ graph.cc:641 ] begin build node videodecoder [2022-11-08 13:09:03,428][ INFO][ graph.cc:647 ] build node videodecoder success [2022-11-08 13:09:03,428][ INFO][ graph.cc:641 ] begin build node videodemuxer [2022-11-08 13:09:03,428][ INFO][ graph.cc:647 ] build node videodemuxer success [2022-11-08 13:09:03,428][ INFO][ graph.cc:641 ] begin build node videoencoder [2022-11-08 13:09:03,428][ INFO][ graph.cc:647 ] build node videoencoder success [2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, collapse_emotion:out_data -> draw_emotion:in_emotion [2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, custom_resize:out_image -> image_transpose:in_image [2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, draw_emotion:out_data -> videoencoder:in_video_frame [2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, emotion_infer:confidence -> collapse_emotion:confidence [2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, emotion_infer:predicts -> collapse_emotion:predicts [2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, expand_box:roi_image -> face_resize:in_image [2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, face_detect:out_cls -> face_post:in_cls [2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, face_detect:out_conf -> face_post:in_conf [2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, face_detect:out_loc -> face_post:in_loc [2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, face_mean:out_data -> face_normalize:in_data [2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, face_normalize:out_data -> emotion_infer:input [2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, face_post:has_face -> draw_emotion:in_face [2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, face_post:has_face -> expand_box:in_data [2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, face_post:no_face -> videoencoder:in_video_frame [2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, face_resize:out_image -> face_transpose:in_image [2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, face_transpose:out_image -> face_mean:in_data [2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, image_transpose:out_image -> mean:in_data [2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, mean:out_data -> normalize:in_data [2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, normalize:out_data -> face_detect:input [2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, video_input:out_video_url -> videodemuxer:in_video_url [2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, videodecoder:out_video_frame -> custom_resize:in_image [2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, videodecoder:out_video_frame -> face_post:in_image [2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, videodemuxer:out_video_packet -> videodecoder:in_video_packet [2022-11-08 13:09:03,429][ INFO][flowunit_group.cc:406 ] node: face_mean get batch size is 8 [2022-11-08 13:09:03,429][ INFO][flowunit_group.cc:406 ] node: face_normalize get batch size is 8 [2022-11-08 13:09:03,429][ INFO][flowunit_group.cc:406 ] node: face_resize get batch size is 8 [2022-11-08 13:09:03,430][ INFO][flowunit_group.cc:406 ] node: face_transpose get batch size is 8 [2022-11-08 13:09:03,430][ INFO][flowunit_group.cc:406 ] node: image_transpose get batch size is 8 [2022-11-08 13:09:03,430][ INFO][flowunit_group.cc:406 ] node: mean get batch size is 8 [2022-11-08 13:09:03,430][ INFO][flowunit_group.cc:406 ] node: normalize get batch size is 8 [2022-11-08 13:09:03,430][ INFO][flowunit_group.cc:406 ] node: videodecoder get batch size is 1 [2022-11-08 13:09:03,430][ INFO][flowunit_group.cc:406 ] node: videodemuxer get batch size is 1 [2022-11-08 13:09:03,430][ INFO][flowunit_group.cc:406 ] node: video_input get batch size is 8 [2022-11-08 13:09:03,430][ INFO][flowunit_group.cc:406 ] node: videoencoder get batch size is 1 [2022-11-08 13:09:03,431][ INFO][session_context.cc:40 ] session context start se id:11520f80-cc37-4c49-9cf3-3784b7440ca4 [2022-11-08 13:09:03,957][ INFO][flowunit_group.cc:406 ] node: collapse_emotion get batch size is 1 [2022-11-08 13:09:04,009][ INFO][flowunit_group.cc:406 ] node: custom_resize get batch size is 1 [2022-11-08 13:09:04,010][ INFO][flowunit_group.cc:406 ] node: draw_emotion get batch size is 1 [2022-11-08 13:09:04,011][ INFO][flowunit_group.cc:406 ] node: expand_box get batch size is 1 [2022-11-08 13:09:04,013][ INFO][flowunit_group.cc:406 ] node: face_post get batch size is 1 [2022-11-08 13:09:04,431][ INFO][flowunit_group.cc:406 ] node: emotion_infer get batch size is 1 [2022-11-08 13:09:04,558][ INFO][flowunit_group.cc:406 ] node: face_detect get batch size is 8 [2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: collapse_emotion #0 [2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: custom_resize #0 [2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: draw_emotion #0 [2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: emotion_infer #0 [2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: expand_box #0 [2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: face_detect #0 [2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: face_mean #0 [2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: face_normalize #0 [2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: face_post #0 [2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: face_resize #0 [2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: face_transpose #0 [2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: image_transpose #0 [2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: mean #0 [2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: normalize #0 [2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: video_input #0 [2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: videodecoder #0 [2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: videodemuxer #0 [2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: videoencoder #0 [2022-11-08 13:09:04,559][ INFO][ graph.cc:1084] topo index: 0, video_input [2022-11-08 13:09:04,559][ INFO][ graph.cc:1084] topo index: 1, videodemuxer [2022-11-08 13:09:04,559][ INFO][ graph.cc:1084] topo index: 2, videodecoder [2022-11-08 13:09:04,559][ INFO][ graph.cc:1084] topo index: 3, custom_resize [2022-11-08 13:09:04,559][ INFO][ graph.cc:1084] topo index: 4, image_transpose [2022-11-08 13:09:04,559][ INFO][ graph.cc:1084] topo index: 5, mean [2022-11-08 13:09:04,559][ INFO][ graph.cc:1084] topo index: 6, normalize [2022-11-08 13:09:04,559][ INFO][ graph.cc:1084] topo index: 7, face_detect [2022-11-08 13:09:04,559][ INFO][ graph.cc:1084] topo index: 8, face_post [2022-11-08 13:09:04,559][ INFO][ graph.cc:1084] topo index: 9, expand_box [2022-11-08 13:09:04,559][ INFO][ graph.cc:1084] topo index: 10, face_resize [2022-11-08 13:09:04,559][ INFO][ graph.cc:1084] topo index: 11, face_transpose [2022-11-08 13:09:04,559][ INFO][ graph.cc:1084] topo index: 12, face_mean [2022-11-08 13:09:04,559][ INFO][ graph.cc:1084] topo index: 13, face_normalize [2022-11-08 13:09:04,560][ INFO][ graph.cc:1084] topo index: 14, emotion_infer [2022-11-08 13:09:04,560][ INFO][ graph.cc:1084] topo index: 15, collapse_emotion [2022-11-08 13:09:04,560][ INFO][ graph.cc:1084] topo index: 16, draw_emotion [2022-11-08 13:09:04,560][ INFO][ graph.cc:1084] topo index: 17, videoencoder [2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: videodemuxer port: in_video_url priority: 1 [2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: videodecoder port: in_video_packet priority: 2 [2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: custom_resize port: in_image priority: 3 [2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: image_transpose port: in_image priority: 4 [2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: mean port: in_data priority: 5 [2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: normalize port: in_data priority: 6 [2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: face_detect port: input priority: 7 [2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: face_post port: in_cls priority: 8 [2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: face_post port: in_conf priority: 8 [2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: face_post port: in_image priority: 8 [2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: face_post port: in_loc priority: 8 [2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: expand_box port: in_data priority: 9 [2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: face_resize port: in_image priority: 10 [2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: face_transpose port: in_image priority: 11 [2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: face_mean port: in_data priority: 12 [2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: face_normalize port: in_data priority: 13 [2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: emotion_infer port: input priority: 14 [2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: collapse_emotion port: confidence priority: 15 [2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: collapse_emotion port: predicts priority: 15 [2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: draw_emotion port: in_emotion priority: 16 [2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: draw_emotion port: in_face priority: 16 [2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: videoencoder port: in_video_frame priority: 17 [2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, expand_box:roi_image -> face_resize:in_image [2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, face_resize:out_image -> face_transpose:in_image [2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, custom_resize:out_image -> image_transpose:in_image [2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, image_transpose:out_image -> mean:in_data [2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, mean:out_data -> normalize:in_data [2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, videodemuxer:out_video_packet -> videodecoder:in_video_packet [2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, video_input:out_video_url -> videodemuxer:in_video_url [2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, face_post:no_face -> videoencoder:in_video_frame [2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, draw_emotion:out_data -> videoencoder:in_video_frame [2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, face_transpose:out_image -> face_mean:in_data [2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, face_detect:out_conf -> face_post:in_conf [2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, videodecoder:out_video_frame -> face_post:in_image [2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, normalize:out_data -> face_detect:input [2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, face_detect:out_loc -> face_post:in_loc [2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, face_detect:out_cls -> face_post:in_cls [2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, face_mean:out_data -> face_normalize:in_data [2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, face_post:has_face -> expand_box:in_data [2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, emotion_infer:predicts -> collapse_emotion:predicts [2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, emotion_infer:confidence -> collapse_emotion:confidence [2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, videodecoder:out_video_frame -> custom_resize:in_image [2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, collapse_emotion:out_data -> draw_emotion:in_emotion [2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, face_post:has_face -> draw_emotion:in_face [2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, face_normalize:out_data -> emotion_infer:input [2022-11-08 13:09:04,560][ INFO][ graph_checker.cc:786 ] node: draw_emotion, key: match_node, value: face_post [2022-11-08 13:09:04,560][ INFO][ graph_checker.cc:786 ] node: collapse_emotion, key: match_node, value: expand_box [2022-11-08 13:09:04,560][ INFO][ graph_checker.cc:786 ] node: videoencoder, key: match_node, value: face_post [2022-11-08 13:09:04,560][ INFO][ graph_checker.cc:786 ] node: face_post, key: match_node, value: videodecoder [2022-11-08 13:09:04,560][ INFO][ graph_checker.cc:786 ] node: expand_box, key: match_node, value: face_post [2022-11-08 13:09:04,560][ INFO][flow_scheduler.cc:93 ] init scheduler with 48 threads, max 1536 [2022-11-08 13:09:04,561][ INFO][ editor_plugin.cc:661 ] template_dir:/usr/local/share/modelbox/project-template/project [2022-11-08 13:09:04,561][ INFO][ match_stream.cc:529 ] node video_input, port External_Port, inherit backward level 0 [2022-11-08 13:09:04,563][ INFO][ match_stream.cc:529 ] node videodemuxer, port in_video_url, inherit backward level 0 [2022-11-08 13:09:04,567][ INFO][ ffmpeg_reader.cc:112 ] Source url:@DEMO_VIDEO_DIR@/emotion_test_video.mp4, reconnect:true, rw_timeout:30s [2022-11-08 13:09:04,567][ERROR][ ffmpegreader.cc:72 ] avformat open input[**@DEMO_VIDEO_DIR@/emotion_testvideo.mp4] failed, err No such file or directory** [2022-11-08 13:09:04,567][ INFO][video_demuxer_flowunit.cc:272 ] Open reader falied, set DEMUX_STATUS failed [2022-11-08 13:09:04,567][ INFO][video_demuxer_flowunit.cc:244 ] failed init Demuxer [2022-11-08 13:09:04,567][ INFO][flowunit_group.cc:95 ] flowunit video_demuxer data pre return: Fault [2022-11-08 13:09:04,568][ INFO][ node.cc:757 ] node: videodemuxer, sess id: 11520f80-cc37-4c49-9cf3-3784b7440ca4, data ctx finished [2022-11-08 13:09:04,568][ INFO][ match_stream.cc:529 ] node videodecoder, port in_video_packet, inherit backward level 0 [2022-11-08 13:09:04,568][ INFO][video_decoder_flowunit.cc:251 ] Video Decode Start [2022-11-08 13:09:04,568][ INFO][nvcodec_video_decoder.cc:125 ] Init decode in gpu 0 [2022-11-08 13:09:04,568][ERROR][nvcodec_video_decoder.cc:235 ] ffmpeg code id[0] for nvcodec is not supported [2022-11-08 13:09:04,568][ERROR][video_decoder_flowunit.cc:273 ] Video decoder init failed [2022-11-08 13:09:04,568][ INFO][flowunit_group.cc:95 ] flowunit video_decoder data pre return: Fault [2022-11-08 13:09:04,568][ INFO][ node.cc:757 ] node: videodecoder, sess id: 11520f80-cc37-4c49-9cf3-3784b7440ca4, data ctx finished [2022-11-08 13:09:04,569][ INFO][ match_stream.cc:529 ] node custom_resize, port in_image, inherit backward level 0 [2022-11-08 13:09:04,569][ INFO][ node.cc:757 ] node: custom_resize, sess id: 11520f80-cc37-4c49-9cf3-3784b7440ca4, data ctx finished [2022-11-08 13:09:04,569][ INFO][ match_stream.cc:529 ] node image_transpose, port in_image, inherit backward level 0 [2022-11-08 13:09:04,569][ INFO][ match_stream.cc:529 ] node mean, port in_data, inherit backward level 0 [2022-11-08 13:09:04,570][ INFO][ match_stream.cc:529 ] node normalize, port in_data, inherit backward level 0 [2022-11-08 13:09:04,570][ INFO][ match_stream.cc:529 ] node face_detect, port input, inherit backward level 0 [2022-11-08 13:09:04,570][ INFO][ match_stream.cc:529 ] node face_post, port in_loc, inherit backward level 0 [2022-11-08 13:09:04,570][ INFO][ match_stream.cc:529 ] node face_post, port in_image, inherit backward level 0 [2022-11-08 13:09:04,570][ INFO][ match_stream.cc:529 ] node face_post, port in_cls, inherit backward level 0 [2022-11-08 13:09:04,570][ INFO][ match_stream.cc:529 ] node face_post, port in_conf, inherit backward level 0 [2022-11-08 13:09:04,570][ INFO][ match_stream.cc:529 ] node videoencoder, port in_video_frame, inherit backward level 0 [2022-11-08 13:09:04,571][ INFO][ match_stream.cc:529 ] node expand_box, port in_data, inherit backward level 0 [2022-11-08 13:09:04,571][ INFO][ match_stream.cc:529 ] node face_resize, port in_image, inherit backward level 0 [2022-11-08 13:09:04,571][ INFO][ node.cc:757 ] node: expand_box, sess id: 11520f80-cc37-4c49-9cf3-3784b7440ca4, data ctx finished [2022-11-08 13:09:04,571][ INFO][ match_stream.cc:529 ] node face_transpose, port in_image, inherit backward level 0 [2022-11-08 13:09:04,571][ INFO][ match_stream.cc:529 ] node face_mean, port in_data, inherit backward level 0 [2022-11-08 13:09:04,571][ INFO][ match_stream.cc:529 ] node face_normalize, port in_data, inherit backward level 0 [2022-11-08 13:09:04,572][ INFO][ match_stream.cc:529 ] node emotion_infer, port input, inherit backward level 0 [2022-11-08 13:09:04,572][ INFO][ match_stream.cc:529 ] node collapse_emotion, port predicts, inherit backward level 0 [2022-11-08 13:09:04,572][ INFO][ match_stream.cc:529 ] node collapse_emotion, port confidence, inherit backward level 0 [2022-11-08 13:09:04,572][ INFO][ match_stream.cc:529 ] node draw_emotion, port in_face, inherit backward level 0 [2022-11-08 13:09:04,572][ INFO][ match_stream.cc:529 ] node draw_emotion, port in_emotion, inherit backward level 0 [2022-11-08 13:09:04,573][ INFO][ node.cc:757 ] node: collapse_emotion, sess id: 11520f80-cc37-4c49-9cf3-3784b7440ca4, data ctx finished [2022-11-08 13:09:04,573][ WARN][video_encoder_flowunit.cc:299 ] Input meta [dest_url] should be set in port [in_video_frame] for each stream, Use default_dest_url in config is only for debug [2022-11-08 13:09:04,573][ERROR][video_encoder_flowunit.cc:226 ] Input [frame_info] is empty [2022-11-08 13:09:04,573][ INFO][flowunit_group.cc:95 ] flowunit video_encoder data pre return: Fault [2022-11-08 13:09:04,573][ INFO][ node.cc:757 ] node: draw_emotion, sess id: 11520f80-cc37-4c49-9cf3-3784b7440ca4, data ctx finished [2022-11-08 13:09:04,573][ INFO][ node.cc:757 ] node: videoencoder, sess id: 11520f80-cc37-4c49-9cf3-3784b7440ca4, data ctx finished [2022-11-08 13:09:04,573][ INFO][ session.cc:121 ] session 11520f80-cc37-4c49-9cf3-3784b7440ca4 is over, running session count 0 [2022-11-08 13:09:04,573][ INFO][session_context.cc:44 ] session context finish se id:11520f80-cc37-4c49-9cf3-3784b7440ca4 和toml文件， 可能是 image 这个source_url 的地址找不到，但是我改成/opt下的测试文件，再次点击运行，好像toml文件又被改成上图的地址了，这个是我哪儿使用不对么？

tau233 commented 1 year ago

当前UI前端和后端同步有点问题，下个版本会解决。当前可以通过moelbox-tool命令行执行