search

py499372727 / AgentSims

AgentSims is an easy-to-use infrastructure for researchers from all disciplines to test the specific capacities they are interested in.
MIT License
787 stars 99 forks source link

How to run AgentSims with LLama2 #21

Open myrainbowandsky opened 1 year ago

myrainbowandsky commented 1 year ago

How to run AgentSims with LLama2

alvinowyong commented 1 year ago

I managed to get this running with Ollama serving Llama2 combined with LiteLLM as a Local OpenAI Proxy Server that will accept and serve OpenAI request to Ollama. You will still need to follow through the setup process in the README but when you run the ./restart.sh script you can prepend OPENAI_BASE_URL="http://localhost:<LITELLM_PORT> before the nohup python main.py to point to the running Local OpenAI Proxy Server.