facebookresearch / detectron2

Detectron2 is a platform for object detection, segmentation and other visual recognition tasks.
https://detectron2.readthedocs.io/en/latest/
Apache License 2.0
30.56k stars 7.49k forks source link

Densepose on video #3280

Open asluborski opened 3 years ago

asluborski commented 3 years ago

I was wondering if it is possible to run densepose annotations on a mp4 with detectron2?

In the projects folder, you can run densepose with applynet.py but this only works on images. I tried running this commmand

Instructions To Reproduce the Issue and Full Logs :

I created a folder named DensePose in the configs folder and added in the .yaml and got the model id and file as well from the DensePose model zoo linked here: https://github.com/facebookresearch/detectron2/blob/master/projects/DensePose/README.md

cd demo

python demo.py --config-file ../configs/DensePose/R_101_FPN_DL_s1x.yaml \
  --video-input video.mp4 \
  [--other-options]
  --opts MODEL.WEIGHTS detectron2://DensePose/R_101_FPN_DL_s1x/165712116/model_final_844d15.pkl

with densepose weights and annotations but Detectron2 gives me this error:

Non-existent config key: MODEL.DENSEPOSE_ON

I know DensePose video exists but it is out of date as it uses caffe2 separated from pytorch.

Is this possible or can you not run on video?

My environment:

github-actions[bot] commented 3 years ago

You've chosen to report an unexpected problem or bug. Unless you already know the root cause of it, please include details about it by filling the issue template. The following information is missing: "Instructions To Reproduce the Issue and Full Logs"; "Your Environment";

FurkanGozukara commented 11 months ago

i also have this freaking problem how to fix?