search

pipilurj / bootstrapped-preference-optimization-BPO

code for "Strengthening Multimodal Large Language Model with Bootstrapped Preference Optimization"
Apache License 2.0
45 stars 1 forks source link

error running the script #7

Closed Artanic30 closed 2 months ago

Artanic30 commented 2 months ago

Hi, thanks for your great work! I'm trying to run this code base and encounter some issues. For example, in llava/train/bpo_llava.py line946,

    collator = LLaVADPODataCollator(data_args=data_args, tokenizer=tokenizer, max_length=1024)

the following error shows up

TypeError: DPODataCollatorWithPadding.__init__() got an unexpected keyword argument 'tokenizer'

Could you kindly provide the specific version of trl or how to install trl ?

Artanic30 commented 2 months ago

I managed to solve the issue by installing 

trl==0.7.2
transformers==4.31.0

I hope the authors could verify the versions and update the requirements.

pipilurj commented 2 months ago

Thanks a lot! We added the dependencies in the installation file.