search

X-PLUG / mPLUG-DocOwl

mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding
Apache License 2.0
1.6k stars 101 forks source link

DocOwl1.5 training code? #51

Open coder4nlp opened 7 months ago

coder4nlp commented 7 months ago

When will the training code be released?Thx.

HAWLYQ commented 7 months ago

Hi, @coder4nlp , the training code is scheduled for release at the end of this month. If you are urgent to finetune our model, you can refer to the training code of mPLUG-Owl2 and make some revisions to adjust to our model. Some hyper-parameters can refer to our paper.

whalefa1I commented 6 months ago

Hi, @coder4nlp , the training code is scheduled for release at the end of this month. If you are urgent to finetune our model, you can refer to the training code of mPLUG-Owl2 and make some revisions to adjust to our model. Some hyper-parameters can refer to our paper.

almost there！

HAWLYQ commented 6 months ago

Hi, @coder4nlp , the training code is scheduled for release at the end of this month. If you are urgent to finetune our model, you can refer to the training code of mPLUG-Owl2 and make some revisions to adjust to our model. Some hyper-parameters can refer to our paper.

almost there！

training codes with DeepSpeed is under debugging and testing ｡ﾟ･ (>﹏<) ･ﾟ｡

coder4nlp commented 6 months ago

Hi, @coder4nlp , the training code is scheduled for release at the end of this month. If you are urgent to finetune our model, you can refer to the training code of mPLUG-Owl2 and make some revisions to adjust to our model. Some hyper-parameters can refer to our paper.

almost there！

training codes with DeepSpeed is under debugging and testing ｡ﾟ･ (>﹏<) ･ﾟ｡

@HAWLYQ So sad......｡ﾟ･ (>﹏<) ･ﾟ｡

AR-javis commented 6 months ago

@HAWLYQ can you test for deepspeed stage 3 integrations, specifically for deadlock issues while training/fine-tuning?

HAWLYQ commented 6 months ago

@HAWLYQ can you test for deepspeed stage 3 integrations, specifically for deadlock issues while training/fine-tuning?

Hi, @AR-javis , I'm debugging with deepspeed zero3~ I will try my best to release it within a week~

coder4nlp commented 6 months ago

where are the schedules?

HAWLYQ commented 6 months ago

where are the schedules?

Within this week~

HAWLYQ commented 6 months ago

Hi, @coder4nlp @whalefa1I @AR-javis We have released training codes for finetuning docowl1.5 in https://github.com/X-PLUG/mPLUG-DocOwl/tree/main/DocOwl1.5. It's temporarily supported by DeepSpeed zero2. We meet deadlock issues with zero3, if you have any suggestions to share with us, we will appreciate very much~

coder4nlp commented 6 months ago

@HAWLYQ Thank you very much!

Coobiw commented 6 months ago

hello, how about the venv requirements? I've not seen the requirements.txt.

HAWLYQ commented 6 months ago

hello, how about the venv requirements? I've not seen the requirements.txt.

Hi, @Coobiw , our environment is the same as mPLUG-Owl2, you can follow instructions at https://github.com/X-PLUG/mPLUG-Owl/tree/main/mPLUG-Owl2 to prepare environments.