expectedparrot / edsl

Design, conduct and analyze results of AI-powered surveys and experiments. Simulate social science and market research with large numbers of AI agents and LLMs.
https://docs.expectedparrot.com
MIT License
174 stars 18 forks source link

Scenario.from_image() not working #628

Closed rbyh closed 3 months ago

rbyh commented 3 months ago

Model is not returning a response Code to reproduce:

from edsl.questions import QuestionFreeText
from edsl import Scenario

q = QuestionFreeText(
    question_name = "test",
    question_text = "Describe this image." 
)

s = Scenario.from_image(Scenario.example_image())

results = q.by(s).run()
results.select("test").print(format="rich")
image
johnjosephhorton commented 3 months ago

need to use a model w/ vision

On Mon, Jun 10, 2024 at 9:36 AM Robin Yerkes Horton < @.***> wrote:

Model is not returning a response Code to reproduce:

from edsl.questions import QuestionFreeText from edsl import Scenario

q = QuestionFreeText( question_name = "test", question_text = "Describe this image." )

s = Scenario.from_image(Scenario.example_image())

results = q.by(s).run() results.select("test").print(format="rich")

image.png (view on web) https://github.com/expectedparrot/edsl/assets/50664588/44cd3780-515e-4aed-8cd3-f07918075a2b

— Reply to this email directly, view it on GitHub https://github.com/expectedparrot/edsl/issues/628, or unsubscribe https://github.com/notifications/unsubscribe-auth/AADDNMQFJ7WJA7NSDDEDASLZGWTXJAVCNFSM6AAAAABJCKW2TKVHI2DSMVQWIX3LMV43ASLTON2WKOZSGM2DGOJVGA2DQMQ . You are receiving this because you are subscribed to this thread.Message ID: @.***>

rbyh commented 3 months ago

oh geez whoops!

johnjosephhorton commented 3 months ago

yeah, but we should add a check for this since it's such an easy mistake to make. Actually, we should probably make gpt-4o our default anyway

On Mon, Jun 10, 2024 at 9:47 AM Robin Yerkes Horton < @.***> wrote:

oh geez whoops!

— Reply to this email directly, view it on GitHub https://github.com/expectedparrot/edsl/issues/628#issuecomment-2158426961, or unsubscribe https://github.com/notifications/unsubscribe-auth/AADDNMS6NB3CW7PR3IY3G3LZGWU7PAVCNFSM6AAAAABJCKW2TKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNJYGQZDMOJWGE . You are receiving this because you commented.Message ID: @.***>