sunsmarterjie / ChatterBox

ChatterBox: Multi-round Multimodal Referring and Grounding, Multimodal, Multi-round dialogues
Apache License 2.0
50 stars 1 forks source link

About Data Generation #4

Open jdg900 opened 6 months ago

jdg900 commented 6 months ago

Thank you for sharing the nice work!

The prompt generation code you provided is helpful for me.

I have one question about the code.

In the get_prompt() function, the generated prompt starts " [{'role': 'system', 'content': ~ " .

I think this prompt is a system message.

However, this generated prompt is fed to the content of role 'user' in https://github.com/sunsmarterjie/ChatterBox/blob/main/CB-300K/dataset_generation/MRG/chat.py#L131.

Is this the right approach?

I'm not familiar with the GPT API, so I'm curious.

I'm looking forward to hearing your reply!

yuanzhang0 commented 6 months ago

Thanks for your reminder, we will fix that. Actually, removing the start of prompt won't change the result too much