How to generate instructions automatically using GPT-4?

OpenGVLab / Ask-Anything

[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.

https://vchat.opengvlab.com/

MIT License

2.86k stars 230 forks source link

How to generate instructions automatically using GPT-4? #77

Open yuanrr opened 7 months ago

yuanrr commented 7 months ago

I noticed that the video dataset such as NextQA has many different instructions for each sample, how can I create this? (in the provided files in Ask-Anything/video_chat2/DATA.md)

XuecWu commented 6 months ago

This also puzzles me. Looking forward to your reply.

fang196 commented 3 months ago

The code has been released in #53 .

Andy1621 commented 3 months ago

Hi! For the instruction creation, please check the pipeline in our paper. Specifically, we use ChatGPT to summarize the abstract or introduction of the related dataset paper, obtaining the dataset description. Then we manually write the task description and instruction example, thus using ChatGPT to generate similar ones via multi-turn revision.