search

happyharrycn / actionformer_release

Code release for ActionFormer (ECCV 2022)
MIT License
415 stars 77 forks source link

Obtaining short segments #118

Closed EmreOzkose closed 10 months ago

EmreOzkose commented 12 months ago

Hi, thanks for sharing great work.

I tried to segment YouCook2 training videos and observed that actionformer gives much shorter segments. Do you have a clue about that? I tried this because I observed the same issue when I tested random YouTube videos.

happyharrycn commented 10 months ago

Detecting longer segment will require modifying the number of pyramid levels and tweaking the regression range on each level. More levels and larger regression range are generally preferred to cover longer segments.

EmreOzkose commented 10 months ago

The model which is trained on Epic Kitchen produces short segments. I think this is because of the distribution of training data durations. On the other hand, the model which is trained on activity-net produces longer segments.

happyharrycn commented 10 months ago

It looks like this is now resolved. I am marking this issue as closed. Feel free to re-open if needed.