search

LLaVA-VL / LLaVA-NeXT

1.01k stars 55 forks source link

llavaconfig error #62

Open homiec opened 2 weeks ago

homiec commented 2 weeks ago

File "/home/ma-user/anaconda3/envs/llava/lib/python3.10/site-packages/transformers/configuration_utils.py", line 264, in getattribute return super().getattribute(key) AttributeError: 'LlavaConfig' object has no attribute 'mlp_bias'

What is the cause of this problem?

reachsak commented 1 week ago

I have the same problem, have you figure out the solution yet ?

Stevetich commented 1 week ago

I also have this problem when trying to test the inference with LLaVA-NeXT-Video-7B-DPO.

Stevetich commented 1 week ago

I also have this problem when trying to test the inference with LLaVA-NeXT-Video-7B-DPO.

It seems I have fixed this problem. We have to build the environment by pip install -e ".[train]". The problem is because of the environment.

reachsak commented 1 week ago

I also have this problem when trying to test the inference with LLaVA-NeXT-Video-7B-DPO.

It seems I have fixed this problem. We have to build the environment by pip install -e ".[train]". The problem is because of the environment.

I still have the problem after pip install -e ".[train]". May I know what operation system you are system ? I'm currently on Mac OS Sonoma

linzy5 commented 1 week ago

@reachsak Hi, in the pyproject.toml, the train target require transformers version is : 

"transformers@git+https://github.com/huggingface/transformers.git@1c39974a4c4036fd641bc1191cc32799f85715a4"

I uninstall transformers and reinstall by 

pip install transformers@git+https://github.com/huggingface/transformers.git@1c39974a4c4036fd641bc1191cc32799f85715a4

solved the problem.

The werid thing is, I check the transformers version, the versions after 4.40.0 is conclude this commit, "1c39974a4c4036fd641bc1191cc32799f85715a4", I dont know this issue still happened.