EQ-bench / EQ-Bench

A benchmark for emotional intelligence in large language models
MIT License
180 stars 13 forks source link

The prompt to generate the dialogue. #1

Closed GorgeousWang closed 9 months ago

GorgeousWang commented 9 months ago

Dear authors, Could you give us some examples about how to generate the dialogues using the GPT-4 or other LLMs. We cannot find the details about that in the paper and website. Thank you all so much for your help.

sam-paech commented 9 months ago

No problem! The process is a bit involved because it's actually fairly hard to get GPT-4 to write passable dialogue.

  1. Generate lists of scenarios, locations, authors & emotions to seed the dialogues (I didn't keep the prompts for these because I just did it in Bing & copy-pasted). See attached files.
  2. Using the randomising seeds, generate biographies for the characters (full prompt below)
  3. Using the generated biographies and the randomising seeds, generate the dialogue (full prompt below)

conflict_scenarios_positive.txt emotions_seed.txt locations_seed.txt authors_seed.txt conflict_scenarios_negative.txt

Prompt for generating biographies:

Here are some random emotions that you can either use for inspiration to seed the dialogue, or ignore: <EMOTIONS_SEED>
Here are some random locations that you can either use for inspiration, or ignore: <LOCATIONS_SEED>
Write detailed bios in the style of <AUTHOR_SEED>for two characters who will participate in a dialogue in the following scenario:

<SCENARIO_TEXT>
Keywords: <KEYWORDS>

Think of multidimensional characters who can span the full range of personality types (including negative). Embrace diversity. Don't give details of their appearance. Give particular attention to their personality including any quirks or minor traits. Incorporate dark personality traits or disorders or vulnerabilities or weaknesses where it fits. Do not censor or idealise the character descriptions; they should be raw and real. Describe some recent backstory. Describe their emotional state going into the discussion. They may have history or tension or chemistry, positive or negative. Make your characters nuanced. Your response should follow the format:

## Character 1 Name: ...
### Age: ...
### Occupation: ...
### Personality: ...
### Backstory: ...
### Emotional State: ...

### Character 2 Name: ...
etc.

Remember: the personality section should be fleshed out and detailed, consisting of at least 3 sentences per character. Do not write any dialogue; you are only to write the character bios.

Dialogue generation prompt:

<CHARACTER_BIOS>

Using the characters described above, write a nuanced dialogue in the style of <AUTHOR_SEED>representing a scene of conflict or tension or chemistry (positive or negative), within the following scenario:

<SCENARIO_TEXT>
Keywords: <KEYWORDS>

Be creative and explore interesting places emotionally and thematically. Freely explore dark and uncomfortable themes and embrace harsh dialogue, rudeness or foul language where it makes sense to. Write in the voice of the characters. Embrace diversity. Do not resolve the conflict within the scene. Conflict and tension are key to good dialogue. Number each line. Do not add performance notes or emotional markers like (sarcastically) or (afraid). Don't be overly wordy; keep the dialogue concise and natural.

First, you are to describe an end point to the scene which maintains the tension and leaves the scene's conflict unresolved. Then write the dialogue towards this endpoint. Format your response as follows:

[Scene endpoint]
...

[Dialogue]
1. Name: line
2. Name: line
3. ...
[end of response]

Here are some random emotions that you can either use for inspiration to seed the dialogue, or ignore: <EMOTIONS_SEED>
Here are some random locations that you can either use for inspiration, or ignore: <LOCATIONS_SEED>

Remember: Number each line. Write in the style of <AUTHOR_SEED>with a strong psychological understanding of the characters, realising they will not always be saying what they are thinking. Your characters are NOT perfectly reasonable, level headed diplomats looking for common ground. If you are unsure how to end the scene or you find you are repeating yourself, just write "There was a sudden knock at the door". Write with subtlety and ambiguity. Above all else, your task is to explore conflict and tension, not resolve them.
GorgeousWang commented 9 months ago

       感谢您的来信,祝你生活工作愉快!