search

happyharrycn / actionformer_release

Code release for ActionFormer (ECCV 2022)
MIT License
448 stars 78 forks source link

Obtaining short segments #118

Closed EmreOzkose closed 1 year ago

EmreOzkose commented 1 year ago

Hi, thanks for sharing great work.

I tried to segment YouCook2 training videos and observed that actionformer gives much shorter segments. Do you have a clue about that? I tried this because I observed the same issue when I tested random YouTube videos.

happyharrycn commented 1 year ago

Detecting longer segment will require modifying the number of pyramid levels and tweaking the regression range on each level. More levels and larger regression range are generally preferred to cover longer segments.

EmreOzkose commented 1 year ago

The model which is trained on Epic Kitchen produces short segments. I think this is because of the distribution of training data durations. On the other hand, the model which is trained on activity-net produces longer segments.

happyharrycn commented 1 year ago

It looks like this is now resolved. I am marking this issue as closed. Feel free to re-open if needed.