opendilab / LMDrive

[CVPR 2024] LMDrive: Closed-Loop End-to-End Driving with Large Language Models
Apache License 2.0
671 stars 58 forks source link

Application to water surface scenarios #75

Closed CoderXuans closed 1 month ago

CoderXuans commented 2 months ago

@deepcs233 Hello, thank you for open-sourcing your work. I am working on obstacle avoidance for water surface unmanned boats and am interested in applying your framework to my research. Given that constraints on water surfaces are generally less than those on roads, I want to know if it's feasible to fine-tune LMDrive with a dataset of water surface images that I collect to achieve obstacle avoidance on water. If feasible, would it be necessary to fine-tune both the visual encoder and the command instructions?