search

wayveai / Driving-with-LLMs

PyTorch implementation for the paper "Driving with LLMs: Fusing Object-Level Vector Modality for Explainable Autonomous Driving"
Apache License 2.0
453 stars 39 forks source link

About the prompt #12

Open frkmac3 opened 11 months ago

frkmac3 commented 11 months ago

https://github.com/wayveai/Driving-with-LLMs/blob/ae36cc351f61657b2bd37294d43ff55a4564087e/utils/training_utils.py#L211 Hi, codes here already integrated output label into prompt, so the model already know the real label before prediction? So what about the testing stage when the model don't know the real label?

melights commented 10 months ago

Hi @frkmac3, during testing stage, the generation function use user_input_ids to prompt the model, which doesn't contains the label. https://github.com/wayveai/Driving-with-LLMs/blob/ae36cc351f61657b2bd37294d43ff55a4564087e/models/vector_lm.py#L270

Hope that helps. If you have any further questions or need additional information, please feel free to ask.

MLgeek7325 commented 10 months ago

您好，您的邮件我已收到！