search

YuanJianhao508 / RAG-Driver

A Multi-Modal Large Language Model with Retrieval-augmented In-context Learning capacity designed for generalisable and explainable end-to-end driving
Apache License 2.0
72 stars 4 forks source link

Question of "database of driver experience" #3

Closed lucien-ye closed 4 months ago

lucien-ye commented 6 months ago

image image

Your work is very interesting. But I have a little confused about the "retrieval database of driver experience" remaking on the picture above. The database seems constructed by the history of the generation results? Look forward to your further explanation, thank you very much.

YuanJianhao508 commented 6 months ago

Hi @lucien-ye , Thank you for your question! The "retrieval database of driver experience" is consist with human expert demonstration (i.e. driving video + human annotation of driving action explanation and justification). In principle, the model generated explanation can also be updated to the database, but we haven't examinate this in our project.