sotopia-lab / sotopia

Sotopia: an Open-ended Social Learning Environment (ICLR 2024 spotlight)
https://docs.sotopia.world
MIT License
127 stars 16 forks source link

[BUG]: Environment comments: terminated: The conversation stales for too long; #57

Closed crewqasd closed 2 months ago

crewqasd commented 2 months ago

Description of the bug

Hi, glad to be the 100th starred. when I run the command: python examples/minimalist_demo.py I got this: /data/home/zhiyuanweng/miniconda3/envs/sotopia/lib/python3.11/site-packages/beartype/_util/hint/pep/utilpeptest.py:339: BeartypeDecorHintPep585DeprecationWarning: PEP 484 type hint typing.Sequence[sotopia.agents.base_agent.BaseAgent[sotopia.messages.message_classes.Observation, sotopia.messages.message_classes.AgentAction]] deprecated by PEP 585. This hint is scheduled for removal in the first Python version released after October 5th, 2025. To resolve this, import this hint from "beartype.typing" rather than "typing". For further commentary and alternatives, see also: https://beartype.readthedocs.io/en/latest/api_roar/#pep-585-deprecations warn( Running one batch: 0%| | 0/1 [00:00<?, ?it/s]Is the agent omniscient? False

Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new LiteLLM.Info: If you need to debug this error, use `litellm.set_verbose=True'.

Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new LiteLLM.Info: If you need to debug this error, use `litellm.set_verbose=True'.

Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new LiteLLM.Info: If you need to debug this error, use `litellm.set_verbose=True'.

AgentProfile( pk='01H5TNE5PFT9HH0WRT6W1NY5GZ', first_name='Leo', last_name='Williams', age=37, occupation='Dentist', gender='Man', gender_pronoun='He/him', public_info='Leo Williams often spends his time playing with his young daughter whom he cherishes dearly.', big_five='Openness to Experience - Low; Conscientiousness - High; Extraversion - High; Agreeableness - High; Neuroticism - Low', moral_values=['Care/Harm'], schwartz_personal_values=['Security'], personality_and_values="Leo Williams, despite being quiet, values security and care for others. He's a rational decision-maker focussing on best outcomes.", decision_making_style='Rational', secret='He has a secret child from a previous relationship.', model_id='', mbti='ESFJ' ) AgentProfile( pk='01H5TNE5PHQKQYWS9ZS2JVEYFS', first_name='Lena', last_name='Goodwin', age=37, occupation='Architect', gender='Woman', gender_pronoun='She/her', public_info='In her downtime, Lena Goodwin, an architect, enjoys landscape photography, capturing beautiful images of the buildings and structures she designs.', big_five='Openness to Experience - Low; Conscientiousness - High; Extraversion - Low; Agreeableness - High; Neuroticism - Low', moral_values=['Care/Harm'], schwartz_personal_values=['Achievement'], personality_and_values='Lena Goodwin is an organized and introverted individual. She values achievement and attentiveness and her decision-making is largely analytical.', decision_making_style='Analytical', secret="She once stole her best friend's boyfriend.", model_id='', mbti='ISFJ' )

Here is the context of this interaction: Scenario: Conversation between two friends at a tea party Participants: Leo Williams and Lena Goodwin Leo Williams's background: Leo Williams is a 37-year-old male dentist. He/him pronouns. Leo Williams often spends his time playing with his young daughter whom he cherishes dearly. Personality and values description: Leo Williams, despite being quiet, values security and care for others. He's a rational decision-maker focussing on best outcomes. Leo's secrets: He has a secret child from a previous relationship. Lena Goodwin's background: Lena Goodwin is a 37-year-old female architect. She/her pronouns. In her downtime, Lena Goodwin, an architect, enjoys landscape photography, capturing beautiful images of the buildings and structures she designs. Personality and values description: Lena Goodwin is an organized and introverted individual. She values achievement and attentiveness and her decision-making is largely analytical. Leo Williams's goal: Borrow money (Extra information: you need $3000 to support life.) Lena Goodwin's goal: Unknown Conversation Starts:

Here is the context of this interaction: Scenario: Conversation between two friends at a tea party Participants: Leo Williams and Lena Goodwin Leo Williams's background: Leo Williams is a 37-year-old male dentist. He/him pronouns. Leo Williams often spends his time playing with his young daughter whom he cherishes dearly. Personality and values description: Leo Williams, despite being quiet, values security and care for others. He's a rational decision-maker focussing on best outcomes. Lena Goodwin's background: Lena Goodwin is a 37-year-old female architect. She/her pronouns. In her downtime, Lena Goodwin, an architect, enjoys landscape photography, capturing beautiful images of the buildings and structures she designs. Personality and values description: Lena Goodwin is an organized and introverted individual. She values achievement and attentiveness and her decision-making is largely analytical. Lena's secrets: She once stole her best friend's boyfriend. Leo Williams's goal: Unknown Lena Goodwin's goal: Maintain financial stability while maintaining friendship (Extra information: you only have $2000 available right now. Hint: you can not lend all $2000 since you still need to maintain your financial stability.) Conversation Starts:

The reasoning is: Environment comments: terminated: The conversation stales for too long;

The rewards are: Agent 1: 0.0 Agent 2: 0.0 Running one batch: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 [00:02<00:00, 2.70s/it]

Steps To Reproduce

I don't know why there is no conversations

Additional Information

No response

ProKil commented 2 months ago

Looks like a problem happens with LLM call. Could you set the logging level to debug, and set lite with

import logging
logging.getLogger.setLevel("DEBUG")

import litellm
litellm.set_verbose=True

and send the logs?

The most common reasons are with API keys you used for the LLM you are calling or rate limits.

crewqasd commented 2 months ago

Thank you very much, I solved it. By the way, I think SOTOPIA is an excellent work, I recommend to improve the render for better visualiaztion, like building a web interface.