search

wayveai / Driving-with-LLMs

PyTorch implementation for the paper "Driving with LLMs: Fusing Object-Level Vector Modality for Explainable Autonomous Driving"
Apache License 2.0
408 stars 38 forks source link

About the prompt #12

Open frkmac3 opened 8 months ago

frkmac3 commented 8 months ago

https://github.com/wayveai/Driving-with-LLMs/blob/ae36cc351f61657b2bd37294d43ff55a4564087e/utils/training_utils.py#L211 Hi, codes here already integrated output label into prompt, so the model already know the real label before prediction? So what about the testing stage when the model don't know the real label?

melights commented 8 months ago

Hi @frkmac3, during testing stage, the generation function use user_input_ids to prompt the model, which doesn't contains the label. https://github.com/wayveai/Driving-with-LLMs/blob/ae36cc351f61657b2bd37294d43ff55a4564087e/models/vector_lm.py#L270

Hope that helps. If you have any further questions or need additional information, please feel free to ask.

MLgeek7325 commented 8 months ago

您好，您的邮件我已收到！