cunjunyu / STAR

[ECCV 2020] Code for "Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Prediction"
MIT License
338 stars 78 forks source link

Training deterministic model #14

Closed JiajianLu closed 2 years ago

JiajianLu commented 2 years ago

Hi can i ask how to train the deterministic model? Should I just feed the temporal input embedding without concatenating gaussian noise into the output layer? Thank you!

cunjunyu commented 2 years ago

Thanks for your interest in the work.

Should I just feed the temporal input embedding without concatenating gaussian noise into the output layer?

Generally yes. However, this repo is built to reproduce the result of the stochastic version, which is the main result. Since I have left SenseTime, I cannot access the original code of the deterministic version. You may need to modify the details of the code and tune the hyperparameters by yourself for the deterministic version.

Thanks.

JiajianLu commented 2 years ago

Thank you for your quick reply. I'll try it out. Here is another question, for the stochastic model, how should I find the best prediction among all the sampled predictions when the ground truth is unknown?

cunjunyu commented 2 years ago

I assume you are referring to the test phase.

In that case, you simply cannot evaluate your model this way unless the evaluation algorithm accepts multiple predictions. Or, you may utilize a certain sampling method to sample the trajectory with the highest possibility. For example, one very simple strategy is to use the mean of the distribution predicted.

JiajianLu commented 2 years ago

Got it. In that case the mean of the distribution would be 0 since we are training with standard gaussian?

cunjunyu commented 2 years ago

Nope, only the noise is the standard guassian. You may take the mean of the prediction.

cunjunyu commented 2 years ago

I will close the issue for now, please feel free to reopen it if you have any further questions.

ycl204432 commented 2 years ago

Hello, I would like to ask how to train a deterministic model. I tried to simply round off the random noise, but the training result is not correct.