sotopia-lab / sotopia

Sotopia: an Open-ended Social Learning Environment (ICLR 2024 spotlight)
https://docs.sotopia.world
MIT License
127 stars 16 forks source link

Feat/calculate model performance #54

Closed clementou closed 1 month ago

clementou commented 2 months ago

📑 Description

Cleanup on calculating model performance script. Works with LiteLLM feature change and tested on Llama 3. Removed more references to LLM_Name required to properly write EpisodeLogs. Removed Epilogs symmetry check, unsure if this is required.

✅ Checks

ℹ Additional Information