MCZhi / DIPP

[TNNLS] Differentiable Integrated Prediction and Planning Framework for Urban Autonomous Driving
https://mczhi.github.io/DIPP/
197 stars 40 forks source link

Simultaneous Training Problem #23

Closed QingZhuanya closed 10 months ago

QingZhuanya commented 10 months ago

Hello, thank you very much for your sharing. My question is that only a single graphics card can be used for training. Can multiple graphics cards be used for simultaneous training?

MCZhi commented 10 months ago

Hi, @QingZhuanya, thank you for reaching out. You can try using DDP with only the prediction model. However, while integrating it with the planner, it's worth noting that Theseus might not support multi-GPU training. This could potentially make joint training with multiple GPUs unfeasible.

QingZhuanya commented 10 months ago

@MCZhi okey,thanks. There is another question, can the model rely on road information to give a reference line, as long as the reference line is a series of points in the center of the road?

MCZhi commented 10 months ago

Sure, that makes sense. We find the reference line as a series of waypoints on the road according to the ground truth trajectory in the code.

QingZhuanya commented 10 months ago

That is, do you take the gt as the reference line, and then input the reference line and the initial trajectory output of the model into the planning layer?

发自我的iPhone

------------------ Original ------------------ From: Zhiyu Huang @.> Date: Sat, Aug 26, 2023 2:36 AM To: MCZhi/DIPP @.> Cc: qinying long @.>, Mention @.> Subject: Re: [MCZhi/DIPP] Simultaneous Training Problem (Issue #23)

Sure, that makes sense. We find the reference line as a series of waypoints on the road according to the ground truth trajectory in the code.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: @.***>

MCZhi commented 10 months ago

Regarding the reference line, we do use the gt to find the nearest waypoints and use a cubic spline to interpolate the points and obtain the final reference line. The model (planner) takes the reference line and initial plan of the model as input.

QingZhuanya commented 10 months ago

thanks,I have a try. Thanks again for your sharing.