JoeHEZHAO / expert_traj

ICCV2021 Expert-Goal Trajectory Prediction
25 stars 5 forks source link

Unfair comparison with previous work #1

Closed Kguo-cs closed 2 years ago

Kguo-cs commented 2 years ago

I think your comparison is unfair. Previous work like PEC_net only generate one trajectory based on the best of 20 destinations for computing Min_ade. However, you generate 20 trajectories based on the best of 20 destinations and then choose the best ade. I evaluate your model like PEC-net. The ade reuslt is: 13.297966124938515 (rsample) and 10.666338165054066(mean).

JoeHEZHAO commented 2 years ago

Thanks for your interest.

PECNET is a good work and it samples 20 destinations using their well-trained CVAE, whereas this work retrieves the same amount of destinations via only doing near-nest neighbor. There is no sampling from a learned neural network on destinations, and thus sampling is focused on the other 11 trajectory points from the learned model.

Note in the paper we said, "...which decouples the goal inference from subsequent trajectory sampling and therefore reprioritizes the sampling on the overall trajectories."

JoeHEZHAO commented 2 years ago

I assume there is no further question. Feel free to reopen it.