search

heaversm / crew-llamafile

Run CrewAI agent workflows on local LLM models with Llamafile and Ollama
36 stars 6 forks source link

Works well, but openAI still charging me for gpt-4o usage?? #1

Open raminderpalsingh opened 4 months ago

raminderpalsingh commented 4 months ago

I understand that the crewai code makes several calls using the openAI key, but I didn't expect to generate so many tokens running this a 4-5 times (623k). Is ths expected? Or did I do something wrong? thanks!

Note: the runs well, similar to the video. I am running the multi-agent.py file.

heaversm commented 3 months ago

That is a lot. What did you specify for the number of retries? If this is not set, i think it will just keep trying to solve a problem for you. It also can build up a fairly large context for each prompt depending on what you’re asking it to do

Mike Heavers Digital Futures Told https://digitalfuturestold.com/.

On Mon, Jul 22, 2024 at 1:59 AM raminderpalsingh @.***> wrote:

I understand that the crewai code makes several calls using the openAI key, but I didn't expect to generate so many tokens running this a 4-5 times (623k). Is ths expected? Or did I do something wrong? thanks!

Note: the runs well, similar to the video. I am running the multi-agent.py file.

— Reply to this email directly, view it on GitHub https://github.com/heaversm/crew-llamafile/issues/1, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAD7CXKO4T2PFB7BCHZCCG3ZNTCYZAVCNFSM6AAAAABLH3Y7O6VHI2DSMVQWIX3LMV43ASLTON2WKOZSGQZDEMZTGI4DONI . You are receiving this because you are subscribed to this thread.Message ID: @.***>