The purpose of using key objects

[exiawsh]

Hi, thanks for your great work! What's the purpose of the defination of key objects. It seems that the key objects is both in the questions and answers part. Do you expect the definition of Key objects to appear in pre prompt or do you need post-processing to replace it with a standardized format?

[ChonghaoSima]

The definition of key objects is used in the prediction and planning stages, where those questions will only consider the key objects.

"Do you expect the definition of Key objects to appear in pre prompt or do you need post-processing to replace it with a standardized format?" I am not fully understanding this, could you elaborate a bit?

[exiawsh]

@ChonghaoSima Can it be leaked to the model? Or the model still needs to make its own predictions.

[ChonghaoSima]

It should be predicted by the models in the perception stages. Then in the prediction and planning stage, we assume the model already “know” the key objects. That’s what we said in the paper, that those QAs are in a logical order.

Best Chonghao Sima

---

From: exiawsh @.> Sent: Friday, January 12, 2024 10:21:55 PM To: OpenDriveLab/DriveLM @.> Cc: Sima, Chonghao @.>; Mention @.> Subject: Re: [OpenDriveLab/DriveLM] The purpose of using key objects (Issue #11)

---- External Email: Use caution with attachments, links, or sharing data ----

@ChonghaoSimahttps://github.com/ChonghaoSima Can it be leaked to the model? Or the model still needs to make its own predictions.

— Reply to this email directly, view it on GitHubhttps://github.com/OpenDriveLab/DriveLM/issues/11#issuecomment-1889338502, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AM6RGLV77YHKJD5TUTXEXVLYOFBIHAVCNFSM6AAAAABBXMSDZ2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBZGMZTQNJQGI. You are receiving this because you were mentioned.Message ID: @.***>

[exiawsh]

Thank you!