search

YuanJianhao508 / RAG-Driver

A Multi-Modal Large Language Model with Retrieval-augmented In-context Learning capacity designed for generalisable and explainable end-to-end driving
Apache License 2.0
75 stars 5 forks source link

When will the processed version of BDDX be available? #4

Closed Xiaolong-RRL closed 4 months ago

Xiaolong-RRL commented 5 months ago

Dear author:

thanks for your great work!

I wander when will the processed version of BDDX and the full training progress be available?

YuanJianhao508 commented 5 months ago

Hi @Xiaolong-RRL ,

Thank you for your interest in our work! We have just uploaded the processed BDD-X in the repo. For training code, currently it can be done with minimal one sample training, the retrieval engine is still under cleaning. We will try to update that asap!

Best regards, Jianhao

Xiaolong-RRL commented 5 months ago

Thanks for your quickly reply~

but it seems that there is some problem about the video_process.zip you have uploaded, and it cannot be decompressed normally.

UltramanSleepless commented 5 months ago

Hello! I ocur the problem. It seems that you have forget the file "final" in your video_process.zip FileNotFoundError: [Errno 2] No such file or directory: 'video_process/final/conversation_bddx_train.json'

YuanJianhao508 commented 5 months ago

Hi @Xiaolong-RRL and @UltramanSleepless ,

Thanks for your message!

Seems to me that one of you can unzip the file normally, I guess it might due to the different in platforms? I will to upload another version to see if it works.

Regarding the final conversation. Yes currently you can run ./video_process/create_bddx_json.py to get the base conversation, the final conversation can also be generated automatically after we update the retrieval engine part of the code. Please wait for a few moment.

Best Regards, Jianhao

YuanJianhao508 commented 5 months ago

Hi @Xiaolong-RRL ,

I have just update the link to the processed BDDX dataset, maybe you can have another try?

Best Regards, Jianhao

Xiaolong-RRL commented 5 months ago

Hi @Xiaolong-RRL ,

I have just update the link to the processed BDDX dataset, maybe you can have another try?

Best Regards, Jianhao

The current version file can be used normally. Thank you for your prompt reply～