search

joonspk-research / generative_agents

Generative Agents: Interactive Simulacra of Human Behavior
Apache License 2.0
16.26k stars 2.09k forks source link

Price and mitigations #115

Open Lesaje opened 11 months ago

Lesaje commented 11 months ago

Hi, I started test simulation using base_the_ville_isabella_maria_klaus, and for 40 seconds of simulation it spent ~2.6$. Are this expenditure rates sound right? If I'm correct, it's somewhere around 2.6/0.0015$/1K tokens = ~1.7 million tokens for 3 persons and 40 seconds.

If so, what's the progress on optimization and/or switching to other LLM, for example, Alpaca?

Thank you all for responses/thoughts.

Cazforshort commented 11 months ago

That is accurate.

kroryan commented 11 months ago

I want to know the same

Jun-Pu commented 11 months ago

A 100 steps simulation (about 16min gaming time) costs me $2.64.

stearnsbq commented 8 months ago

oobabooga has a openai compliant API now so you could run this privately assuming you have the hardware.

https://github.com/oobabooga/text-generation-webui/wiki/12-%E2%80%90-OpenAI-API