search

xiaoachen98 / Open-LLaVA-NeXT

An open-source implementation for training LLaVA-NeXT.
398 stars 20 forks source link

data generation code #4

Closed trinhvg closed 6 months ago

trinhvg commented 6 months ago

Hello,

Thank you for your work. I am interested in creating custom instruction data and I wonder if you will release the code to obtain the data for "open-llava-next_instruct_mix1M.json"?

I have reviewed LLAVA and Instruction Tuning with GPT-4 but have not been able to find this specific information. Any assistance or references to helpful sources would be greatly appreciated.

Thank you.

xiaoachen98 commented 6 months ago

Hello,

Thank you for your work. I am interested in creating custom instruction data and I wonder if you will release the code to obtain the data for "open-llava-next_instruct_mix1M.json"?

I have reviewed LLAVA and Instruction Tuning with GPT-4 but have not been able to find this specific information. Any assistance or references to helpful sources would be greatly appreciated.

Thank you.

We introduce the same VQA instruction data (DocVQA, SynDog-EN, ChartQA, DVQA, AI2D, and GeoQA+) as same as llava-next. You can see the detailed information in our Data.md and their blog.