search

MCZhi / GameFormer-Planner

[ICCV & CVPR Workshop] Learning-enabled Interactive Prediction and Planning Framework for Autonomous Vehicles
https://mczhi.github.io/GameFormer/
MIT License
143 stars 17 forks source link

train erro #9

Closed StephenGordan closed 9 months ago

StephenGordan commented 9 months ago

Why does it get stuck during training without giving any error messages?

屏幕截图 2023-11-24 142647
StephenGordan commented 9 months ago

The same problem in gameformer Interaction Prediction，but training suscessully in fameformer Open-loop Planning .

StephenGordan commented 9 months ago

Something wrong with optimizer.step() or data ?

MCZhi commented 9 months ago

I am not sure what's the problem. My guess is that a deadlock occurs in the data loading phase, so I would like to suggest reducing the number of worker threads in the DataLoader.

StephenGordan commented 9 months ago

Although the above issue hasn't been resolved, I managed to complete the model training on another device using a Docker environment. One issue is that Docker can't visualize in real-time. Is it possible to save the visualization data as videos or images?

MCZhi commented 9 months ago

See #10.