haotian-liu / LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
https://llava.hliu.cc
Apache License 2.0
19.12k stars 2.1k forks source link

Error came out when I was applying delta. #55

Open zxcvbn114514 opened 1 year ago

zxcvbn114514 commented 1 year ago

PS A:\LLaVA> py -3 -m llava.model.apply_delta --base A:/vicuna-minigpt/vicuna/llama-13b/LLaMA/output/13B --target A:/llava13b --delta A:/llava-delta Loading base model Loading checkpoint shards: 100%|█████████████████████████████████████████████████████████| 3/3 [00:17<00:00, 5.93s/it] Loading delta Loading checkpoint shards: 100%|█████████████████████████████████████████████████████████| 3/3 [00:20<00:00, 6.97s/it] Some weights of the model checkpoint at A:/llava-delta were not used when initializing LlamaForCausalLM: ['model.mm_projector.weight', 'model.mm_projector.bias']

haotian-liu commented 1 year ago

Hi, thank you for your interest in our work.

I noticed this error in your log:

Some weights of the model checkpoint at A:/llava-delta were not used when initializing LlamaForCausalLM: ['model.mm_projector.weight', 'model.mm_projector.bias']

This may suggest that the transformers library is not installed correctly. Please try doing a clean https://github.com/haotian-liu/LLaVA#install with a new conda environment. You may also first try reinstalling transformers by first uninstalling and then reinstalling, if you do not want to start a new conda environment, but this is not guaranteed to fix all version related issues:

pip uninstall transformers
pip install git+https://github.com/haotian-liu/transformers_llava.git@988b6abb3b7da9a5cbb5051e994706f7f88c2565

Thanks, and please let me know if you find further issues.

zxcvbn114514 commented 1 year ago

Hi, thank you for your interest in our work.

I noticed this error in your log:

Some weights of the model checkpoint at A:/llava-delta were not used when initializing LlamaForCausalLM: ['model.mm_projector.weight', 'model.mm_projector.bias']

This may suggest that the transformers library is not installed correctly. Please try doing a clean https://github.com/haotian-liu/LLaVA#install with a new conda environment. You may also first try reinstalling transformers by first uninstalling and then reinstalling, if you do not want to start a new conda environment, but this is not guaranteed to fix all version related issues:

pip uninstall transformers
pip install git+https://github.com/haotian-liu/transformers_llava.git@988b6abb3b7da9a5cbb5051e994706f7f88c2565

Thanks, and please let me know if you find further issues.

I'll certainly try it. Thanks a lot btw. You are really committed to your work

zxcvbn114514 commented 1 year ago

Hi, thank you for your interest in our work.

I noticed this error in your log:

Some weights of the model checkpoint at A:/llava-delta were not used when initializing LlamaForCausalLM: ['model.mm_projector.weight', 'model.mm_projector.bias']

This may suggest that the transformers library is not installed correctly. Please try doing a clean https://github.com/haotian-liu/LLaVA#install with a new conda environment. You may also first try reinstalling transformers by first uninstalling and then reinstalling, if you do not want to start a new conda environment, but this is not guaranteed to fix all version related issues:

pip uninstall transformers
pip install git+https://github.com/haotian-liu/transformers_llava.git@988b6abb3b7da9a5cbb5051e994706f7f88c2565

Thanks, and please let me know if you find further issues.

I reinstalled literally everything, but the error 'Some weights of the model checkpoint at A:/llava-delta were not used when initializing LlamaForCausalLM: ['model.mm_projector.weight', 'model.mm_projector.bias']' still popped out .However the progam continued and finally gave me a mixed model. I started the controller and tried to run it but there was another error : 2023-04-26 11:39:57 | INFO | model_worker | Register to controller 2023-04-26 11:39:59 | ERROR | stderr | Traceback (most recent call last): 2023-04-26 11:39:59 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\site-packages\urllib3\connectionpool.py", line 703, in urlopen 2023-04-26 11:39:59 | ERROR | stderr | httplib_response = self._make_request( 2023-04-26 11:39:59 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\site-packages\urllib3\connectionpool.py", line 449, in _make_request 2023-04-26 11:39:59 | ERROR | stderr | six.raise_from(e, None) 2023-04-26 11:39:59 | ERROR | stderr | File "", line 3, in raise_from 2023-04-26 11:39:59 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\site-packages\urllib3\connectionpool.py", line 444, in _make_request 2023-04-26 11:39:59 | ERROR | stderr | httplib_response = conn.getresponse() 2023-04-26 11:39:59 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\http\client.py", line 1374, in getresponse 2023-04-26 11:39:59 | ERROR | stderr | response.begin() 2023-04-26 11:39:59 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\http\client.py", line 318, in begin 2023-04-26 11:39:59 | ERROR | stderr | version, status, reason = self._read_status() 2023-04-26 11:39:59 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\http\client.py", line 287, in _read_status 2023-04-26 11:39:59 | ERROR | stderr | raise RemoteDisconnected("Remote end closed connection without" 2023-04-26 11:39:59 | ERROR | stderr | http.client.RemoteDisconnected: Remote end closed connection without response 2023-04-26 11:39:59 | ERROR | stderr | 2023-04-26 11:39:59 | ERROR | stderr | During handling of the above exception, another exception occurred: 2023-04-26 11:39:59 | ERROR | stderr | 2023-04-26 11:39:59 | ERROR | stderr | Traceback (most recent call last): 2023-04-26 11:39:59 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\site-packages\requests\adapters.py", line 489, in send 2023-04-26 11:39:59 | ERROR | stderr | resp = conn.urlopen( 2023-04-26 11:39:59 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\site-packages\urllib3\connectionpool.py", line 787, in urlopen 2023-04-26 11:39:59 | ERROR | stderr | retries = retries.increment( 2023-04-26 11:39:59 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\site-packages\urllib3\util\retry.py", line 550, in increment 2023-04-26 11:39:59 | ERROR | stderr | raise six.reraise(type(error), error, _stacktrace) 2023-04-26 11:39:59 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\site-packages\urllib3\packages\six.py", line 769, in reraise 2023-04-26 11:39:59 | ERROR | stderr | raise value.with_traceback(tb) 2023-04-26 11:39:59 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\site-packages\urllib3\connectionpool.py", line 703, in urlopen 2023-04-26 11:39:59 | ERROR | stderr | httplib_response = self._make_request( 2023-04-26 11:39:59 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\site-packages\urllib3\connectionpool.py", line 449, in _make_request 2023-04-26 11:39:59 | ERROR | stderr | six.raise_from(e, None) 2023-04-26 11:39:59 | ERROR | stderr | File "", line 3, in raise_from 2023-04-26 11:39:59 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\site-packages\urllib3\connectionpool.py", line 444, in _make_request 2023-04-26 11:39:59 | ERROR | stderr | httplib_response = conn.getresponse() 2023-04-26 11:39:59 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\http\client.py", line 1374, in getresponse 2023-04-26 11:39:59 | ERROR | stderr | response.begin() 2023-04-26 11:39:59 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\http\client.py", line 318, in begin 2023-04-26 11:39:59 | ERROR | stderr | version, status, reason = self._read_status() 2023-04-26 11:39:59 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\http\client.py", line 287, in _read_status 2023-04-26 11:39:59 | ERROR | stderr | raise RemoteDisconnected("Remote end closed connection without" 2023-04-26 11:39:59 | ERROR | stderr | urllib3.exceptions.ProtocolError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) 2023-04-26 11:39:59 | ERROR | stderr | 2023-04-26 11:39:59 | ERROR | stderr | During handling of the above exception, another exception occurred: 2023-04-26 11:39:59 | ERROR | stderr | 2023-04-26 11:39:59 | ERROR | stderr | Traceback (most recent call last): 2023-04-26 11:39:59 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\runpy.py", line 196, in _run_module_as_main 2023-04-26 11:39:59 | ERROR | stderr | return _run_code(code, main_globals, None, 2023-04-26 11:39:59 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\runpy.py", line 86, in _run_code 2023-04-26 11:39:59 | ERROR | stderr | exec(code, run_globals) 2023-04-26 11:39:59 | ERROR | stderr | File "A:\llava\llava\serve\model_worker.py", line 361, in 2023-04-26 11:39:59 | ERROR | stderr | worker = ModelWorker(args.controller_address, 2023-04-26 11:39:59 | ERROR | stderr | File "A:\llava\llava\serve\model_worker.py", line 122, in init 2023-04-26 11:39:59 | ERROR | stderr | self.register_to_controller() 2023-04-26 11:39:59 | ERROR | stderr | File "A:\llava\llava\serve\model_worker.py", line 136, in register_to_controller 2023-04-26 11:39:59 | ERROR | stderr | r = requests.post(url, json=data) 2023-04-26 11:39:59 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\site-packages\requests\api.py", line 115, in post 2023-04-26 11:39:59 | ERROR | stderr | return request("post", url, data=data, json=json, kwargs) 2023-04-26 11:39:59 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\site-packages\requests\api.py", line 59, in request 2023-04-26 11:39:59 | ERROR | stderr | return session.request(method=method, url=url, kwargs) 2023-04-26 11:39:59 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\site-packages\requests\sessions.py", line 587, in request 2023-04-26 11:39:59 | ERROR | stderr | resp = self.send(prep, send_kwargs) 2023-04-26 11:39:59 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\site-packages\requests\sessions.py", line 701, in send 2023-04-26 11:39:59 | ERROR | stderr | r = adapter.send(request, kwargs) 2023-04-26 11:39:59 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\site-packages\requests\adapters.py", line 547, in send 2023-04-26 11:39:59 | ERROR | stderr | raise ConnectionError(err, request=request) 2023-04-26 11:39:59 | ERROR | stderr | requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))

zxcvbn114514 commented 1 year ago

the controller info

Hi, thank you for your interest in our work.

I noticed this error in your log:

Some weights of the model checkpoint at A:/llava-delta were not used when initializing LlamaForCausalLM: ['model.mm_projector.weight', 'model.mm_projector.bias']

This may suggest that the transformers library is not installed correctly. Please try doing a clean https://github.com/haotian-liu/LLaVA#install with a new conda environment. You may also first try reinstalling transformers by first uninstalling and then reinstalling, if you do not want to start a new conda environment, but this is not guaranteed to fix all version related issues:

pip uninstall transformers
pip install git+https://github.com/haotian-liu/transformers_llava.git@988b6abb3b7da9a5cbb5051e994706f7f88c2565

Thanks, and please let me know if you find further issues.

The controller info: (LLAVA) PS A:\LLAVA> python -m llava.serve.controller --host 0.0.0.0 --port 10000 2023-04-26 11:38:23 | INFO | controller | args: Namespace(host='0.0.0.0', port=10000, dispatch_method='shortest_queue') 2023-04-26 11:38:23 | INFO | controller | Init controller 2023-04-26 11:38:23 | ERROR | stderr | INFO: Started server process [5192] 2023-04-26 11:38:23 | ERROR | stderr | INFO: Waiting for application startup. 2023-04-26 11:38:23 | ERROR | stderr | INFO: Application startup complete. 2023-04-26 11:38:23 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:10000 (Press CTRL+C to quit)

haotian-liu commented 1 year ago

This seems that the installation was not successful, possibly due to some dependency issues.

We have updated the code base by moving most of the LLaVA code to the main repo, and removes the dependency of the custom transformers framework. Please try installing the latest version following the instructions, and see if it fix your issue. Thanks!

zxcvbn114514 commented 1 year ago

This seems that the installation was not successful, possibly due to some dependency issues.

We have updated the code base by moving most of the LLaVA code to the main repo, and removes the dependency of the custom transformers framework. Please try installing the latest version following the instructions, and see if it fix your issue. Thanks!

Thank a lot, I'll try it at once after the holiday.

zxcvbn114514 commented 1 year ago

This seems that the installation was not successful, possibly due to some dependency issues.

We have updated the code base by moving most of the LLaVA code to the main repo, and removes the dependency of the custom transformers framework. Please try installing the latest version following the instructions, and see if it fix your issue. Thanks!

Unfortunately, after I updated the llava.git, the problem still exists.

Here's the info: (llava) PS A:\llava> py -3 -m llava.model.apply_delta --base A:/vicuna-minigpt/vicuna/llama-13b/LLaMA/output/13B --target llava13b --delta A:/llava-delta Loading base model Loading checkpoint shards: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 3/3 [00:08<00:00, 2.97s/it] Loading delta You are using a model of type llama to instantiate a model of type llava. This is not supported for all configurations of models and can yield errors. Some weights of the model checkpoint at openai/clip-vit-large-patch14 were not used when initializing CLIPVisionModel: ['text_model.encoder.layers.2.self_attn.k_proj.weight', 'text_model.encoder.layers.6.self_attn.out_proj.bias', 'text_model.encoder.layers.6.self_attn.q_proj.weight', 'text_model.encoder.layers.6.self_attn.v_proj.bias', 'text_model.encoder.layers.3.self_attn.out_proj.weight', 'text_model.encoder.layers.5.layer_norm2.bias', 'text_model.encoder.layers.5.layer_norm2.weight', 'text_model.encoder.layers.7.layer_norm2.bias', 'text_model.encoder.layers.3.layer_norm2.bias', 'text_model.encoder.layers.1.layer_norm2.bias', 'text_model.encoder.layers.4.layer_norm2.bias', 'text_model.final_layer_norm.bias', 'text_model.encoder.layers.4.self_attn.k_proj.bias', 'text_model.encoder.layers.1.self_attn.k_proj.weight', 'text_model.encoder.layers.0.self_attn.k_proj.bias', 'text_model.encoder.layers.2.layer_norm2.bias', 'text_model.encoder.layers.8.mlp.fc2.bias', 'text_model.encoder.layers.8.self_attn.v_proj.weight', 'text_model.encoder.layers.10.layer_norm1.bias', 'text_model.encoder.layers.8.self_attn.v_proj.bias', 'text_model.encoder.layers.7.mlp.fc2.bias', 'text_model.encoder.layers.0.self_attn.v_proj.weight', 'text_model.encoder.layers.2.self_attn.q_proj.weight', 'text_model.encoder.layers.8.self_attn.q_proj.weight', 'text_model.embeddings.position_embedding.weight', 'text_model.encoder.layers.5.layer_norm1.bias', 'text_model.encoder.layers.8.mlp.fc1.weight', 'text_model.encoder.layers.8.mlp.fc2.weight', 'text_model.encoder.layers.4.mlp.fc2.weight', 'text_model.encoder.layers.4.self_attn.q_proj.bias', 'text_model.encoder.layers.3.mlp.fc1.weight', 'text_model.encoder.layers.11.self_attn.k_proj.weight', 'text_model.encoder.layers.1.layer_norm1.bias', 'text_model.encoder.layers.1.self_attn.out_proj.weight', 'text_model.encoder.layers.3.self_attn.k_proj.weight', 'text_model.encoder.layers.9.layer_norm1.weight', 'text_model.encoder.layers.4.mlp.fc1.weight', 'text_model.encoder.layers.8.self_attn.q_proj.bias', 'text_model.encoder.layers.1.mlp.fc2.bias', 'text_model.encoder.layers.5.layer_norm1.weight', 'text_model.encoder.layers.10.self_attn.v_proj.bias', 'text_model.encoder.layers.4.self_attn.out_proj.weight', 'text_model.encoder.layers.11.mlp.fc1.bias', 'text_model.encoder.layers.7.self_attn.q_proj.bias', 'text_model.embeddings.position_ids', 'visual_projection.weight', 'text_model.encoder.layers.1.mlp.fc1.bias', 'text_model.encoder.layers.0.mlp.fc1.weight', 'text_model.encoder.layers.0.mlp.fc1.bias', 'text_model.encoder.layers.3.self_attn.v_proj.bias', 'text_model.encoder.layers.11.mlp.fc2.bias', 'text_model.encoder.layers.9.mlp.fc1.bias', 'text_model.encoder.layers.7.self_attn.v_proj.weight', 'text_model.encoder.layers.6.self_attn.v_proj.weight', 'text_model.encoder.layers.2.self_attn.k_proj.bias', 'text_model.encoder.layers.6.layer_norm2.weight', 'text_model.encoder.layers.7.mlp.fc1.weight', 'text_model.encoder.layers.7.self_attn.out_proj.bias', 'text_model.encoder.layers.6.layer_norm1.weight', 'text_model.encoder.layers.3.self_attn.out_proj.bias', 'text_model.encoder.layers.6.self_attn.k_proj.weight', 'text_model.encoder.layers.10.mlp.fc2.weight', 'text_model.encoder.layers.0.self_attn.k_proj.weight', 'text_model.encoder.layers.0.self_attn.q_proj.bias', 'text_model.encoder.layers.2.mlp.fc2.bias', 'text_model.encoder.layers.9.layer_norm2.bias', 'text_model.encoder.layers.0.self_attn.v_proj.bias', 'text_model.encoder.layers.3.mlp.fc2.weight', 'text_model.encoder.layers.0.mlp.fc2.weight', 'text_model.encoder.layers.11.self_attn.q_proj.weight', 'text_model.encoder.layers.0.self_attn.q_proj.weight', 'text_model.encoder.layers.9.self_attn.k_proj.weight', 'text_model.encoder.layers.4.mlp.fc2.bias', 'text_model.encoder.layers.0.self_attn.out_proj.weight', 'text_model.encoder.layers.11.self_attn.v_proj.bias', 'text_model.encoder.layers.5.self_attn.q_proj.bias', 'text_model.encoder.layers.10.self_attn.out_proj.bias', 'text_model.encoder.layers.8.self_attn.out_proj.bias', 'text_model.encoder.layers.0.layer_norm1.bias', 'text_model.encoder.layers.9.self_attn.out_proj.weight', 'text_model.encoder.layers.0.self_attn.out_proj.bias', 'text_model.encoder.layers.11.self_attn.out_proj.weight', 'text_model.encoder.layers.8.mlp.fc1.bias', 'text_model.encoder.layers.5.self_attn.out_proj.bias', 'text_model.encoder.layers.7.self_attn.v_proj.bias', 'text_model.encoder.layers.5.self_attn.k_proj.weight', 'text_model.encoder.layers.4.self_attn.v_proj.bias', 'text_model.embeddings.token_embedding.weight', 'text_model.encoder.layers.1.layer_norm2.weight', 'text_model.encoder.layers.6.layer_norm1.bias', 'text_model.encoder.layers.2.layer_norm2.weight', 'text_model.encoder.layers.2.self_attn.v_proj.weight', 'text_model.encoder.layers.1.self_attn.out_proj.bias', 'text_model.encoder.layers.1.mlp.fc1.weight', 'text_model.encoder.layers.0.layer_norm2.weight', 'text_model.encoder.layers.10.self_attn.k_proj.bias', 'text_model.encoder.layers.6.mlp.fc1.bias', 'text_model.encoder.layers.0.layer_norm2.bias', 'text_model.encoder.layers.11.self_attn.out_proj.bias', 'text_model.encoder.layers.9.self_attn.q_proj.bias', 'text_model.encoder.layers.3.self_attn.v_proj.weight', 'text_model.encoder.layers.9.mlp.fc2.bias', 'text_model.encoder.layers.2.self_attn.out_proj.weight', 'text_model.encoder.layers.10.self_attn.q_proj.weight', 'text_model.encoder.layers.9.layer_norm1.bias', 'text_model.encoder.layers.9.self_attn.k_proj.bias', 'text_model.encoder.layers.9.self_attn.q_proj.weight', 'text_model.encoder.layers.1.self_attn.v_proj.weight', 'text_model.encoder.layers.2.self_attn.q_proj.bias', 'text_model.encoder.layers.11.mlp.fc1.weight', 'text_model.encoder.layers.5.self_attn.q_proj.weight', 'text_model.encoder.layers.7.layer_norm1.weight', 'text_model.encoder.layers.9.self_attn.v_proj.bias', 'text_model.encoder.layers.1.self_attn.k_proj.bias', 'text_model.encoder.layers.7.self_attn.k_proj.weight', 'text_model.encoder.layers.3.self_attn.q_proj.weight', 'text_model.encoder.layers.4.layer_norm1.weight', 'text_model.encoder.layers.10.mlp.fc1.bias', 'text_model.encoder.layers.2.mlp.fc1.weight', 'text_model.encoder.layers.9.mlp.fc2.weight', 'text_model.encoder.layers.7.layer_norm2.weight', 'text_model.encoder.layers.5.self_attn.k_proj.bias', 'text_model.encoder.layers.9.self_attn.v_proj.weight', 'text_model.encoder.layers.10.self_attn.v_proj.weight', 'text_model.encoder.layers.11.self_attn.k_proj.bias', 'text_model.encoder.layers.1.mlp.fc2.weight', 'text_model.encoder.layers.10.mlp.fc2.bias', 'text_model.encoder.layers.5.self_attn.v_proj.bias', 'text_model.encoder.layers.6.mlp.fc2.weight', 'text_model.encoder.layers.11.layer_norm1.bias', 'text_model.encoder.layers.6.self_attn.out_proj.weight', 'text_model.encoder.layers.2.mlp.fc1.bias', 'text_model.encoder.layers.1.self_attn.q_proj.bias', 'text_model.encoder.layers.6.self_attn.q_proj.bias', 'text_model.encoder.layers.2.self_attn.out_proj.bias', 'text_model.encoder.layers.7.self_attn.out_proj.weight', 'text_model.encoder.layers.10.self_attn.k_proj.weight', 'text_model.encoder.layers.11.layer_norm2.weight', 'text_model.encoder.layers.9.mlp.fc1.weight', 'text_model.encoder.layers.11.self_attn.v_proj.weight', 'text_model.encoder.layers.2.self_attn.v_proj.bias', 'text_model.encoder.layers.8.layer_norm2.bias', 'text_model.encoder.layers.3.mlp.fc2.bias', 'text_model.encoder.layers.1.self_attn.v_proj.bias', 'text_model.encoder.layers.4.layer_norm1.bias', 'text_model.encoder.layers.10.self_attn.out_proj.weight', 'text_model.encoder.layers.2.layer_norm1.weight', 'text_model.encoder.layers.6.mlp.fc2.bias', 'text_model.encoder.layers.7.self_attn.q_proj.weight', 'text_model.encoder.layers.9.self_attn.out_proj.bias', 'text_model.encoder.layers.10.self_attn.q_proj.bias', 'text_model.encoder.layers.5.self_attn.out_proj.weight', 'text_model.encoder.layers.5.mlp.fc1.bias', 'text_model.encoder.layers.10.mlp.fc1.weight', 'text_projection.weight', 'text_model.encoder.layers.3.mlp.fc1.bias', 'logit_scale', 'text_model.encoder.layers.7.self_attn.k_proj.bias', 'text_model.encoder.layers.4.self_attn.q_proj.weight', 'text_model.encoder.layers.0.layer_norm1.weight', 'text_model.encoder.layers.8.layer_norm1.bias', 'text_model.encoder.layers.5.mlp.fc2.weight', 'text_model.encoder.layers.4.mlp.fc1.bias', 'text_model.encoder.layers.3.layer_norm1.weight', 'text_model.encoder.layers.6.mlp.fc1.weight', 'text_model.encoder.layers.7.layer_norm1.bias', 'text_model.encoder.layers.5.self_attn.v_proj.weight', 'text_model.encoder.layers.2.layer_norm1.bias', 'text_model.encoder.layers.8.self_attn.k_proj.bias', 'text_model.encoder.layers.3.layer_norm2.weight', 'text_model.encoder.layers.6.self_attn.k_proj.bias', 'text_model.final_layer_norm.weight', 'text_model.encoder.layers.11.layer_norm2.bias', 'text_model.encoder.layers.10.layer_norm1.weight', 'text_model.encoder.layers.10.layer_norm2.bias', 'text_model.encoder.layers.10.layer_norm2.weight', 'text_model.encoder.layers.6.layer_norm2.bias', 'text_model.encoder.layers.3.self_attn.k_proj.bias', 'text_model.encoder.layers.3.layer_norm1.bias', 'text_model.encoder.layers.7.mlp.fc1.bias', 'text_model.encoder.layers.11.layer_norm1.weight', 'text_model.encoder.layers.8.self_attn.out_proj.weight', 'text_model.encoder.layers.1.layer_norm1.weight', 'text_model.encoder.layers.2.mlp.fc2.weight', 'text_model.encoder.layers.9.layer_norm2.weight', 'text_model.encoder.layers.5.mlp.fc1.weight', 'text_model.encoder.layers.11.self_attn.q_proj.bias', 'text_model.encoder.layers.4.self_attn.v_proj.weight', 'text_model.encoder.layers.4.self_attn.out_proj.bias', 'text_model.encoder.layers.4.layer_norm2.weight', 'text_model.encoder.layers.0.mlp.fc2.bias', 'text_model.encoder.layers.11.mlp.fc2.weight', 'text_model.encoder.layers.8.layer_norm2.weight', 'text_model.encoder.layers.1.self_attn.q_proj.weight', 'text_model.encoder.layers.8.self_attn.k_proj.weight', 'text_model.encoder.layers.4.self_attn.k_proj.weight', 'text_model.encoder.layers.7.mlp.fc2.weight', 'text_model.encoder.layers.8.layer_norm1.weight', 'text_model.encoder.layers.5.mlp.fc2.bias', 'text_model.encoder.layers.3.self_attn.q_proj.bias']

zxcvbn114514 commented 1 year ago

This seems that the installation was not successful, possibly due to some dependency issues.

We have updated the code base by moving most of the LLaVA code to the main repo, and removes the dependency of the custom transformers framework. Please try installing the latest version following the instructions, and see if it fix your issue. Thanks!

And this is the config.json of my base llama model.There seems to be something wrong with it compared with delta's config.json.

base config: { "architectures": [ "LlamaForCausalLM" ], "bos_token_id": 1, "eos_token_id": 2, "hidden_act": "silu", "hidden_size": 5120, "initializer_range": 0.02, "intermediate_size": 13824, "max_position_embeddings": 2048, "model_type": "llama", "num_attention_heads": 40, "num_hidden_layers": 40, "pad_token_id": 0, "rms_norm_eps": 1e-06, "tie_word_embeddings": false, "torch_dtype": "float16", "transformers_version": "4.29.0.dev0", "use_cache": true, "vocab_size": 32000 }

delta config: { "_name_or_path": "./checkpoints/LLaVA-13B-v0", "architectures": [ "LlamaForCausalLM" ], "bos_token_id": 0, "eos_token_id": 1, "hidden_act": "silu", "hidden_size": 5120, "initializer_range": 0.02, "intermediate_size": 13824, "max_sequence_length": 2048, "mm_hidden_size": 1024, "mm_use_im_start_end": true, "mm_vision_select_layer": -2, "mm_vision_tower": "openai/clip-vit-large-patch14", "model_type": "llama", "num_attention_heads": 40, "num_hidden_layers": 40, "pad_token_id": -1, "rms_norm_eps": 1e-06, "tie_word_embeddings": false, "torch_dtype": "float16", "transformers_version": "4.28.0.dev0", "tune_mm_mlp_adapter": false, "use_cache": true, "use_mm_proj": true, "vocab_size": 32003 }

haotian-liu commented 1 year ago

Hi @zxcvbn114514 This is not an error. It is a warning for us to check, but it is expected as we only used the vision encoder from CLIP, and drop the text encoder weights. Since there are no further errors, I guess you may see the converted weights in llava13b folder?

zxcvbn114514 commented 1 year ago

Hi @zxcvbn114514 This is not an error. It is a warning for us to check, but it is expected as we only used the vision encoder from CLIP, and drop the text encoder weights. Since there are no further errors, I guess you may see the converted weights in llava13b folder?

I continued and error came out when launching a model worker: 2023-05-05 14:18:22 | ERROR | stderr | self.emit(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\handlers.py", line 75, in emit 2023-05-05 14:18:22 | ERROR | stderr | logging.FileHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init__.py", line 1218, in emit 2023-05-05 14:18:22 | ERROR | stderr | StreamHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init__.py", line 1108, in emit 2023-05-05 14:18:22 | ERROR | stderr | self.handleError(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init__.py", line 1038, in handleError 2023-05-05 14:18:22 | ERROR | stderr | sys.stderr.write('Message: %r\n' 2023-05-05 14:18:22 | ERROR | stderr | File "A:\LLaVA\llava\utils.py", line 83, in write 2023-05-05 14:18:22 | ERROR | stderr | self.logger.log(self.log_level, line.rstrip()) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init__.py", line 1547, in log 2023-05-05 14:18:22 | ERROR | stderr | self._log(level, msg, args, kwargs) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1624, in _log 2023-05-05 14:18:22 | ERROR | stderr | self.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1634, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.callHandlers(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1696, in callHandlers 2023-05-05 14:18:22 | ERROR | stderr | hdlr.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 968, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.emit(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\handlers.py", line 75, in emit 2023-05-05 14:18:22 | ERROR | stderr | logging.FileHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1218, in emit 2023-05-05 14:18:22 | ERROR | stderr | StreamHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1108, in emit 2023-05-05 14:18:22 | ERROR | stderr | self.handleError(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1038, in handleError 2023-05-05 14:18:22 | ERROR | stderr | sys.stderr.write('Message: %r\n' 2023-05-05 14:18:22 | ERROR | stderr | File "A:\LLaVA\llava\utils.py", line 83, in write 2023-05-05 14:18:22 | ERROR | stderr | self.logger.log(self.log_level, line.rstrip()) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1547, in log 2023-05-05 14:18:22 | ERROR | stderr | self._log(level, msg, args, kwargs) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init__.py", line 1624, in _log 2023-05-05 14:18:22 | ERROR | stderr | self.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init__.py", line 1634, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.callHandlers(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init__.py", line 1696, in callHandlers 2023-05-05 14:18:22 | ERROR | stderr | hdlr.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init__.py", line 968, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.emit(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\handlers.py", line 75, in emit 2023-05-05 14:18:22 | ERROR | stderr | logging.FileHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init__.py", line 1218, in emit 2023-05-05 14:18:22 | ERROR | stderr | StreamHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init__.py", line 1108, in emit 2023-05-05 14:18:22 | ERROR | stderr | self.handleError(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init__.py", line 1038, in handleError 2023-05-05 14:18:22 | ERROR | stderr | sys.stderr.write('Message: %r\n' 2023-05-05 14:18:22 | ERROR | stderr | File "A:\LLaVA\llava\utils.py", line 83, in write 2023-05-05 14:18:22 | ERROR | stderr | self.logger.log(self.log_level, line.rstrip()) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init__.py", line 1547, in log 2023-05-05 14:18:22 | ERROR | stderr | self._log(level, msg, args, kwargs) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1624, in _log 2023-05-05 14:18:22 | ERROR | stderr | self.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1634, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.callHandlers(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1696, in callHandlers 2023-05-05 14:18:22 | ERROR | stderr | hdlr.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 968, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.emit(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\handlers.py", line 75, in emit 2023-05-05 14:18:22 | ERROR | stderr | logging.FileHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1218, in emit 2023-05-05 14:18:22 | ERROR | stderr | StreamHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1108, in emit 2023-05-05 14:18:22 | ERROR | stderr | self.handleError(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1038, in handleError 2023-05-05 14:18:22 | ERROR | stderr | sys.stderr.write('Message: %r\n' 2023-05-05 14:18:22 | ERROR | stderr | File "A:\LLaVA\llava\utils.py", line 83, in write 2023-05-05 14:18:22 | ERROR | stderr | self.logger.log(self.log_level, line.rstrip()) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1547, in log 2023-05-05 14:18:22 | ERROR | stderr | self._log(level, msg, args, kwargs) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init__.py", line 1624, in _log 2023-05-05 14:18:22 | ERROR | stderr | self.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init__.py", line 1634, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.callHandlers(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init__.py", line 1696, in callHandlers 2023-05-05 14:18:22 | ERROR | stderr | hdlr.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init__.py", line 968, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.emit(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\handlers.py", line 75, in emit 2023-05-05 14:18:22 | ERROR | stderr | logging.FileHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init__.py", line 1218, in emit 2023-05-05 14:18:22 | ERROR | stderr | StreamHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init__.py", line 1108, in emit 2023-05-05 14:18:22 | ERROR | stderr | self.handleError(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init__.py", line 1038, in handleError 2023-05-05 14:18:22 | ERROR | stderr | sys.stderr.write('Message: %r\n' 2023-05-05 14:18:22 | ERROR | stderr | File "A:\LLaVA\llava\utils.py", line 83, in write 2023-05-05 14:18:22 | ERROR | stderr | self.logger.log(self.log_level, line.rstrip()) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init__.py", line 1547, in log 2023-05-05 14:18:22 | ERROR | stderr | self._log(level, msg, args, kwargs) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1624, in _log 2023-05-05 14:18:22 | ERROR | stderr | self.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1634, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.callHandlers(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1696, in callHandlers 2023-05-05 14:18:22 | ERROR | stderr | hdlr.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 968, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.emit(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\handlers.py", line 75, in emit 2023-05-05 14:18:22 | ERROR | stderr | logging.FileHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1218, in emit 2023-05-05 14:18:22 | ERROR | stderr | StreamHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1108, in emit 2023-05-05 14:18:22 | ERROR | stderr | self.handleError(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1038, in handleError 2023-05-05 14:18:22 | ERROR | stderr | sys.stderr.write('Message: %r\n' 2023-05-05 14:18:22 | ERROR | stderr | File "A:\LLaVA\llava\utils.py", line 83, in write 2023-05-05 14:18:22 | ERROR | stderr | self.logger.log(self.log_level, line.rstrip()) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1547, in log 2023-05-05 14:18:22 | ERROR | stderr | self._log(level, msg, args, kwargs) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1624, in _log 2023-05-05 14:18:22 | ERROR | stderr | self.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1634, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.callHandlers(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1696, in callHandlers 2023-05-05 14:18:22 | ERROR | stderr | hdlr.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 968, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.emit(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\handlers.py", line 75, in emit 2023-05-05 14:18:22 | ERROR | stderr | logging.FileHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1218, in emit 2023-05-05 14:18:22 | ERROR | stderr | StreamHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1108, in emit 2023-05-05 14:18:22 | ERROR | stderr | self.handleError(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1038, in handleError 2023-05-05 14:18:22 | ERROR | stderr | sys.stderr.write('Message: %r\n' 2023-05-05 14:18:22 | ERROR | stderr | File "A:\LLaVA\llava\utils.py", line 83, in write 2023-05-05 14:18:22 | ERROR | stderr | self.logger.log(self.log_level, line.rstrip()) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1547, in log 2023-05-05 14:18:22 | ERROR | stderr | self._log(level, msg, args, kwargs) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1624, in _log 2023-05-05 14:18:22 | ERROR | stderr | self.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1634, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.callHandlers(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1696, in callHandlers 2023-05-05 14:18:22 | ERROR | stderr | hdlr.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 968, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.emit(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\handlers.py", line 75, in emit 2023-05-05 14:18:22 | ERROR | stderr | logging.FileHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1218, in emit 2023-05-05 14:18:22 | ERROR | stderr | StreamHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1108, in emit 2023-05-05 14:18:22 | ERROR | stderr | self.handleError(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1038, in handleError 2023-05-05 14:18:22 | ERROR | stderr | sys.stderr.write('Message: %r\n' 2023-05-05 14:18:22 | ERROR | stderr | File "A:\LLaVA\llava\utils.py", line 83, in write 2023-05-05 14:18:22 | ERROR | stderr | self.logger.log(self.log_level, line.rstrip()) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1547, in log 2023-05-05 14:18:22 | ERROR | stderr | self._log(level, msg, args, kwargs) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1624, in _log 2023-05-05 14:18:22 | ERROR | stderr | self.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1634, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.callHandlers(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1696, in callHandlers 2023-05-05 14:18:22 | ERROR | stderr | hdlr.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 968, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.emit(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\handlers.py", line 75, in emit 2023-05-05 14:18:22 | ERROR | stderr | logging.FileHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1218, in emit 2023-05-05 14:18:22 | ERROR | stderr | StreamHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1108, in emit 2023-05-05 14:18:22 | ERROR | stderr | self.handleError(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1038, in handleError 2023-05-05 14:18:22 | ERROR | stderr | sys.stderr.write('Message: %r\n' 2023-05-05 14:18:22 | ERROR | stderr | File "A:\LLaVA\llava\utils.py", line 83, in write 2023-05-05 14:18:22 | ERROR | stderr | self.logger.log(self.log_level, line.rstrip()) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1547, in log 2023-05-05 14:18:22 | ERROR | stderr | self._log(level, msg, args, kwargs) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1624, in _log 2023-05-05 14:18:22 | ERROR | stderr | self.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1634, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.callHandlers(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1696, in callHandlers 2023-05-05 14:18:22 | ERROR | stderr | hdlr.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 968, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.emit(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\handlers.py", line 75, in emit 2023-05-05 14:18:22 | ERROR | stderr | logging.FileHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1218, in emit 2023-05-05 14:18:22 | ERROR | stderr | StreamHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1108, in emit 2023-05-05 14:18:22 | ERROR | stderr | self.handleError(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1038, in handleError 2023-05-05 14:18:22 | ERROR | stderr | sys.stderr.write('Message: %r\n' 2023-05-05 14:18:22 | ERROR | stderr | File "A:\LLaVA\llava\utils.py", line 83, in write 2023-05-05 14:18:22 | ERROR | stderr | self.logger.log(self.log_level, line.rstrip()) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1547, in log 2023-05-05 14:18:22 | ERROR | stderr | self._log(level, msg, args, kwargs) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1624, in _log 2023-05-05 14:18:22 | ERROR | stderr | self.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1634, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.callHandlers(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1696, in callHandlers 2023-05-05 14:18:22 | ERROR | stderr | hdlr.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 968, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.emit(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\handlers.py", line 75, in emit 2023-05-05 14:18:22 | ERROR | stderr | logging.FileHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1218, in emit 2023-05-05 14:18:22 | ERROR | stderr | StreamHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1108, in emit 2023-05-05 14:18:22 | ERROR | stderr | self.handleError(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1038, in handleError 2023-05-05 14:18:22 | ERROR | stderr | sys.stderr.write('Message: %r\n' 2023-05-05 14:18:22 | ERROR | stderr | File "A:\LLaVA\llava\utils.py", line 83, in write 2023-05-05 14:18:22 | ERROR | stderr | self.logger.log(self.log_level, line.rstrip()) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1547, in log 2023-05-05 14:18:22 | ERROR | stderr | self._log(level, msg, args, kwargs) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1624, in _log 2023-05-05 14:18:22 | ERROR | stderr | self.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1634, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.callHandlers(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1696, in callHandlers 2023-05-05 14:18:22 | ERROR | stderr | hdlr.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 968, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.emit(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\handlers.py", line 75, in emit 2023-05-05 14:18:22 | ERROR | stderr | logging.FileHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1218, in emit 2023-05-05 14:18:22 | ERROR | stderr | StreamHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1108, in emit 2023-05-05 14:18:22 | ERROR | stderr | self.handleError(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1038, in handleError 2023-05-05 14:18:22 | ERROR | stderr | sys.stderr.write('Message: %r\n' 2023-05-05 14:18:22 | ERROR | stderr | File "A:\LLaVA\llava\utils.py", line 83, in write 2023-05-05 14:18:22 | ERROR | stderr | self.logger.log(self.log_level, line.rstrip()) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1547, in log 2023-05-05 14:18:22 | ERROR | stderr | self._log(level, msg, args, kwargs) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1624, in _log 2023-05-05 14:18:22 | ERROR | stderr | self.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1634, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.callHandlers(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1696, in callHandlers 2023-05-05 14:18:22 | ERROR | stderr | hdlr.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 968, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.emit(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\handlers.py", line 75, in emit 2023-05-05 14:18:22 | ERROR | stderr | logging.FileHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1218, in emit 2023-05-05 14:18:22 | ERROR | stderr | StreamHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1108, in emit 2023-05-05 14:18:22 | ERROR | stderr | self.handleError(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1038, in handleError 2023-05-05 14:18:22 | ERROR | stderr | sys.stderr.write('Message: %r\n' 2023-05-05 14:18:22 | ERROR | stderr | File "A:\LLaVA\llava\utils.py", line 83, in write 2023-05-05 14:18:22 | ERROR | stderr | self.logger.log(self.log_level, line.rstrip()) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1547, in log 2023-05-05 14:18:22 | ERROR | stderr | self._log(level, msg, args, kwargs) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1624, in _log 2023-05-05 14:18:22 | ERROR | stderr | self.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging__init.py", line 1634, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.callHandlers(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1696, in callHandlers 2023-05-05 14:18:22 | ERROR | stderr | hdlr.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 968, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.emit(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\handlers.py", line 75, in emit 2023-05-05 14:18:22 | ERROR | stderr | logging.FileHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1218, in emit 2023-05-05 14:18:22 | ERROR | stderr | StreamHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1108, in emit 2023-05-05 14:18:22 | ERROR | stderr | self.handleError(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1038, in handleError 2023-05-05 14:18:22 | ERROR | stderr | sys.stderr.write('Message: %r\n' 2023-05-05 14:18:22 | ERROR | stderr | File "A:\LLaVA\llava\utils.py", line 83, in write 2023-05-05 14:18:22 | ERROR | stderr | self.logger.log(self.log_level, line.rstrip()) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1547, in log 2023-05-05 14:18:22 | ERROR | stderr | self._log(level, msg, args, kwargs) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1624, in _log 2023-05-05 14:18:22 | ERROR | stderr | self.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1634, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.callHandlers(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1696, in callHandlers 2023-05-05 14:18:22 | ERROR | stderr | hdlr.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 968, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.emit(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\handlers.py", line 75, in emit 2023-05-05 14:18:22 | ERROR | stderr | logging.FileHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1218, in emit 2023-05-05 14:18:22 | ERROR | stderr | StreamHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1108, in emit 2023-05-05 14:18:22 | ERROR | stderr | self.handleError(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1038, in handleError 2023-05-05 14:18:22 | ERROR | stderr | sys.stderr.write('Message: %r\n' 2023-05-05 14:18:22 | ERROR | stderr | File "A:\LLaVA\llava\utils.py", line 83, in write 2023-05-05 14:18:22 | ERROR | stderr | self.logger.log(self.log_level, line.rstrip()) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1547, in log 2023-05-05 14:18:22 | ERROR | stderr | self._log(level, msg, args, **kwargs) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1624, in _log 2023-05-05 14:18:22 | ERROR | stderr | self.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1634, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.callHandlers(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1696, in callHandlers 2023-05-05 14:18:22 | ERROR | stderr | hdlr.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 968, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.emit(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\handlers.py", line 75, in emit 2023-05-05 14:18:22 | ERROR | stderr | logging.FileHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1218, in emit 2023-05-05 14:18:22 | ERROR | stderr | StreamHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1108, in emit 2023-05-05 14:18:22 | ERROR | stderr | self.handleError(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1038, in handleError 2023-05-05 14:18:22 | ERROR | stderr | sys.stderr.write('Message: %r\n' 2023-05-05 14:18:22 | ERROR | stderr | File "A:\LLaVA\llava\utils.py", line 83, in write 2023-05-05 14:18:22 | ERROR | stderr | self.logger.log(self.log_level, line.rstrip()) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1547, in log 2023-05-05 14:18:22 | ERROR | stderr | self._log(level, msg, args, **kwargs) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1624, in _log 2023-05-05 14:18:22 | ERROR | stderr | self.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1634, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.callHandlers(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1696, in callHandlers 2023-05-05 14:18:22 | ERROR | stderr | hdlr.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 968, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.emit(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\handlers.py", line 75, in emit 2023-05-05 14:18:22 | ERROR | stderr | logging.FileHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1218, in emit 2023-05-05 14:18:22 | ERROR | stderr | StreamHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1108, in emit 2023-05-05 14:18:22 | ERROR | stderr | self.handleError(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1038, in handleError 2023-05-05 14:18:22 | ERROR | stderr | sys.stderr.write('Message: %r\n' 2023-05-05 14:18:22 | ERROR | stderr | File "A:\LLaVA\llava\utils.py", line 83, in write 2023-05-05 14:18:22 | ERROR | stderr | self.logger.log(self.log_level, line.rstrip()) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1547, in log 2023-05-05 14:18:22 | ERROR | stderr | self._log(level, msg, args, **kwargs) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1624, in _log 2023-05-05 14:18:22 | ERROR | stderr | self.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1634, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.callHandlers(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1696, in callHandlers 2023-05-05 14:18:22 | ERROR | stderr | hdlr.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 968, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.emit(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\handlers.py", line 75, in emit 2023-05-05 14:18:22 | ERROR | stderr | logging.FileHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1218, in emit 2023-05-05 14:18:22 | ERROR | stderr | StreamHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1108, in emit 2023-05-05 14:18:22 | ERROR | stderr | self.handleError(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1038, in handleError 2023-05-05 14:18:22 | ERROR | stderr | sys.stderr.write('Message: %r\n' 2023-05-05 14:18:22 | ERROR | stderr | File "A:\LLaVA\llava\utils.py", line 83, in write 2023-05-05 14:18:22 | ERROR | stderr | self.logger.log(self.log_level, line.rstrip()) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1547, in log 2023-05-05 14:18:22 | ERROR | stderr | self._log(level, msg, args, **kwargs) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1624, in _log 2023-05-05 14:18:22 | ERROR | stderr | self.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1634, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.callHandlers(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1696, in callHandlers 2023-05-05 14:18:22 | ERROR | stderr | hdlr.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 968, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.emit(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\handlers.py", line 75, in emit 2023-05-05 14:18:22 | ERROR | stderr | logging.FileHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1218, in emit 2023-05-05 14:18:22 | ERROR | stderr | StreamHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1108, in emit 2023-05-05 14:18:22 | ERROR | stderr | self.handleError(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1038, in handleError 2023-05-05 14:18:22 | ERROR | stderr | sys.stderr.write('Message: %r\n' 2023-05-05 14:18:22 | ERROR | stderr | File "A:\LLaVA\llava\utils.py", line 83, in write 2023-05-05 14:18:22 | ERROR | stderr | self.logger.log(self.log_level, line.rstrip()) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1547, in log 2023-05-05 14:18:22 | ERROR | stderr | self._log(level, msg, args, **kwargs) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1624, in _log 2023-05-05 14:18:22 | ERROR | stderr | self.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1634, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.callHandlers(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1696, in callHandlers 2023-05-05 14:18:22 | ERROR | stderr | hdlr.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 968, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.emit(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\handlers.py", line 75, in emit 2023-05-05 14:18:22 | ERROR | stderr | logging.FileHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1218, in emit 2023-05-05 14:18:22 | ERROR | stderr | StreamHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1108, in emit 2023-05-05 14:18:22 | ERROR | stderr | self.handleError(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1038, in handleError 2023-05-05 14:18:22 | ERROR | stderr | sys.stderr.write('Message: %r\n' 2023-05-05 14:18:22 | ERROR | stderr | File "A:\LLaVA\llava\utils.py", line 83, in write 2023-05-05 14:18:22 | ERROR | stderr | self.logger.log(self.log_level, line.rstrip()) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1547, in log 2023-05-05 14:18:22 | ERROR | stderr | self._log(level, msg, args, **kwargs) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1624, in _log 2023-05-05 14:18:22 | ERROR | stderr | self.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1634, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.callHandlers(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1696, in callHandlers 2023-05-05 14:18:22 | ERROR | stderr | hdlr.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 968, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.emit(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\handlers.py", line 75, in emit 2023-05-05 14:18:22 | ERROR | stderr | logging.FileHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1218, in emit 2023-05-05 14:18:22 | ERROR | stderr | StreamHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1108, in emit 2023-05-05 14:18:22 | ERROR | stderr | self.handleError(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1038, in handleError 2023-05-05 14:18:22 | ERROR | stderr | sys.stderr.write('Message: %r\n' 2023-05-05 14:18:22 | ERROR | stderr | File "A:\LLaVA\llava\utils.py", line 83, in write 2023-05-05 14:18:22 | ERROR | stderr | self.logger.log(self.log_level, line.rstrip()) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1547, in log 2023-05-05 14:18:22 | ERROR | stderr | self._log(level, msg, args, **kwargs) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1624, in _log 2023-05-05 14:18:22 | ERROR | stderr | self.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1634, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.callHandlers(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1696, in callHandlers 2023-05-05 14:18:22 | ERROR | stderr | hdlr.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 968, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.emit(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\handlers.py", line 75, in emit 2023-05-05 14:18:22 | ERROR | stderr | logging.FileHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1218, in emit 2023-05-05 14:18:22 | ERROR | stderr | StreamHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1108, in emit 2023-05-05 14:18:22 | ERROR | stderr | self.handleError(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1038, in handleError 2023-05-05 14:18:22 | ERROR | stderr | sys.stderr.write('Message: %r\n' 2023-05-05 14:18:22 | ERROR | stderr | File "A:\LLaVA\llava\utils.py", line 83, in write 2023-05-05 14:18:22 | ERROR | stderr | self.logger.log(self.log_level, line.rstrip()) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1547, in log 2023-05-05 14:18:22 | ERROR | stderr | self._log(level, msg, args, **kwargs) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1624, in _log 2023-05-05 14:18:22 | ERROR | stderr | self.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1634, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.callHandlers(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1696, in callHandlers 2023-05-05 14:18:22 | ERROR | stderr | hdlr.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 968, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.emit(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\handlers.py", line 75, in emit 2023-05-05 14:18:22 | ERROR | stderr | logging.FileHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1218, in emit 2023-05-05 14:18:22 | ERROR | stderr | StreamHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1108, in emit 2023-05-05 14:18:22 | ERROR | stderr | self.handleError(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1038, in handleError 2023-05-05 14:18:22 | ERROR | stderr | sys.stderr.write('Message: %r\n' 2023-05-05 14:18:22 | ERROR | stderr | File "A:\LLaVA\llava\utils.py", line 83, in write 2023-05-05 14:18:22 | ERROR | stderr | self.logger.log(self.log_level, line.rstrip()) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1547, in log 2023-05-05 14:18:22 | ERROR | stderr | self._log(level, msg, args, **kwargs) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1624, in _log 2023-05-05 14:18:22 | ERROR | stderr | self.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1634, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.callHandlers(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1696, in callHandlers 2023-05-05 14:18:22 | ERROR | stderr | hdlr.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 968, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.emit(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\handlers.py", line 75, in emit 2023-05-05 14:18:22 | ERROR | stderr | logging.FileHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1218, in emit 2023-05-05 14:18:22 | ERROR | stderr | StreamHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1108, in emit 2023-05-05 14:18:22 | ERROR | stderr | self.handleError(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1038, in handleError 2023-05-05 14:18:22 | ERROR | stderr | sys.stderr.write('Message: %r\n' 2023-05-05 14:18:22 | ERROR | stderr | File "A:\LLaVA\llava\utils.py", line 83, in write 2023-05-05 14:18:22 | ERROR | stderr | self.logger.log(self.log_level, line.rstrip()) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1547, in log 2023-05-05 14:18:22 | ERROR | stderr | self._log(level, msg, args, **kwargs) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1624, in _log 2023-05-05 14:18:22 | ERROR | stderr | self.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1634, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.callHandlers(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1696, in callHandlers 2023-05-05 14:18:22 | ERROR | stderr | hdlr.handle(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 968, in handle 2023-05-05 14:18:22 | ERROR | stderr | self.emit(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\handlers.py", line 75, in emit 2023-05-05 14:18:22 | ERROR | stderr | logging.FileHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1218, in emit 2023-05-05 14:18:22 | ERROR | stderr | StreamHandler.emit(self, record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init.py", line 1108, in emit 2023-05-05 14:18:22 | ERROR | stderr | self.handleError(record) 2023-05-05 14:18:22 | ERROR | stderr | File "C:\ProgramData\anaconda3\envs\llava\lib\logging\init__.py", line 1038, in handleError 2023-05-05 14:18:22 | ERROR | stderr | sys.stderr.write('Message: %r\n' 2023-05-05 14:18:22 | ERROR | stderr | File "A:\LLaVA\llava\utils.py", line 83, in write 2023-05-05 14:18:22 | ERROR | stderr | self.logger.log(self.log_level, line.rstrip())

zxcvbn114514 commented 1 year ago

@haotian-liu model_worker_fbe705.log

haotian-liu commented 1 year ago

Hi do you resolve your issue as in #56?

zxcvbn114514 commented 1 year ago

Hi do you resolve your issue as in #56?

Sadly not .I've tried the new version but the problem still exists.

adi-kmt commented 6 months ago

Hi do you resolve your issue as in #56?

Hey @haotian-liu, getting similar issue. What do you think I can do to fix it? Tried it with qwen 1.5