you build `build_vision_tower` twice?

[dragen1860]

1. when create the class , build it the first time.
2. after that, you call initialize_vision_modules in train() in train.py.

   if model_args.vision_tower is not None:
       model.get_model().initialize_vision_modules(
           model_args=model_args,
           fsdp=training_args.fsdp,
           max_token=training_args.model_max_length
       )

i found you build it twice, is my understanding correct?

[yanwei-li]

Hi, we use LLaVA as our pipeline. This is the function in LLaVA. Please refer to LLaVA for this issue.