orgexyz / BlockAGI

Your Self-Hosted, Hackable Research Agent Inspired by AutoGPT
Apache License 2.0
295 stars 49 forks source link

It seems to consume a lot of tokens #4

Open AgimaFR opened 1 year ago

AgimaFR commented 1 year ago

Maybe it's just an impression, but I find that BlockAGI consumes a lot of tokens compared to AgentGPT or SuperAGI.

smiled0g commented 1 year ago

Yes, unfortunately the way BlockAGI works is quite inefficient at the moment. A lot of tokens are used on formatting instructing model to just work well.

Future iteration's goal include reducing this overhead as well as reducing repetition in the narration tasks.