search

Tobias-Fischer / ensemble-event-vpr

Code for our RA-L2020 paper
32 stars 6 forks source link

How to attain the fused event representations with final ensemble matrix? #1

Closed wangxiao5791509 closed 3 years ago

wangxiao5791509 commented 3 years ago

Hi, thanks for your wonderful work on event representation. But I still can't understand how to get the fused event representation. That is to say, how the Eq. (3) is computed? image

According to the algorithm described in Section III, I can't find related context for this part. Thanks for your attention and looking forward to your reply.

Tobias-Fischer commented 3 years ago

Hi @wangxiao5791509, many thanks for your message and your interest in our work!

In our work, rather than considering a single window, we consider multiple windows of varying size. Eq. 3 refers to those multiple windows - they can either have a fixed number of events per window (left term) or the windows can have a fixed time length (right term).

Each of those windows is then separately processed (reconstructing the frame-based images and then running NetVLAD to obtain a feature descriptor).

Finally, the ensemble fusion happens in Eqs. 5+6.

Let me know if you have any further questions.

wangxiao5791509 commented 3 years ago

@Tobias-Fischer Thanks for your explanation. I understand this procedure now.