search

opendilab / LMDrive

[CVPR 2024] LMDrive: Closed-Loop End-to-End Driving with Large Language Models
Apache License 2.0
526 stars 48 forks source link

Questions about model. #24

Open qqqq-0 opened 4 months ago

qqqq-0 commented 4 months ago

请问有试过放开llm的参数进行训练吗，有试过的话请问跟目前 frozen llm的比精度怎么样？

deepcs233 commented 3 months ago

你好，有尝试过添加lora进行finuetune，training loss会低一些，但是实际closed-loop的性能没有测试过