expectedparrot / edsl

Design, conduct and analyze results of AI-powered surveys and experiments. Simulate social science and market research with large numbers of AI agents and LLMs.
https://docs.expectedparrot.com
MIT License
187 stars 19 forks source link

High temperature failure with uninformative errors #791

Closed benjamin-manning closed 3 months ago

benjamin-manning commented 3 months ago

If one runs this: https://github.com/apostolosfilippas/homo_silicus/blob/main/analysis/horton.py at a high temperature (1+) it fails on some of the API calls, but it is not clear what the problem is from the error messages.

johnjosephhorton commented 3 months ago

@benjamin-manning Can you post some error messages + screenshots to help debug?

benjamin-manning commented 3 months ago

@johnjosephhorton

Screenshot 2024-07-22 at 09 16 50 Screenshot 2024-07-22 at 09 17 06
johnjosephhorton commented 3 months ago

@apostolosfilippas The 'undefined Results' makes me think it's an older version of edsl? It might make sense of him to install from github main branch instead