How to instruct fine tune it on a custom dataset ?

DLYuanGod / TinyGPT-V

TinyGPT-V: Efficient Multimodal Large Language Model via Small Backbones

BSD 3-Clause "New" or "Revised" License

1.24k stars 76 forks source link

Open RamziRebai opened 9 months ago

RamziRebai commented 9 months ago

Is it possible to instruction fine tune it on my custom dataset and how to do it with my json file ? data_final10.json

llizhaoxu commented 9 months ago

Thanks for your interest. I think it is possible; you can check the dataset part and the dataload code to find out the dataset structure.