pmixer / TiSASRec.pytorch

https://github.com/JiachengLi1995/TiSASRec in PyTorch
84 stars 15 forks source link

How to reduce evaluate() runtime? #7

Open Blank141 opened 2 months ago

Blank141 commented 2 months ago

Great Job! When running the code I observed that the evaluate time is much larger than the training time is there any solution?

pmixer commented 2 months ago

Great Job! When running the code I observed that the evaluate time is much larger than the training time is there any solution?

Thank you!

Batching etc. should help reducing evaluation time.

And last mha layer most qkv computation is a waste and may be removed temporally.