expectedparrot / edsl

Design, conduct and analyze results of AI-powered surveys and experiments. Simulate social science and market research with large numbers of AI agents and LLMs.
https://docs.expectedparrot.com
MIT License
176 stars 18 forks source link

For completeness, question memory should include question options that were presented #274

Open rbyh opened 5 months ago

rbyh commented 5 months ago

For completeness, question memory should include the question options that were presented, together with the question text and answer.

Eg, here a multiple choice question was added as memory for a free text question. Only the question text and answer are included in the memory:

image
rbyh commented 5 months ago

The memory should also specify the type of question that was asked (mistyped 'test' ^ )

eg here the prompt should also note that the prior question was multiple choice:

image