search

fmeiraf / LLM-budget-assistant

0 stars 0 forks source link

Create failsafe when model fails to run a block of transactions (for big entries) #6

Open fmeiraf opened 11 months ago

fmeiraf commented 11 months ago

Now when the token count is too big and I split it, it needs to make multiple LLM calls. Need to store the ones already ran so I don't need to run them again.

fmeiraf commented 11 months ago

Big inputs seem to face a lot of variance, with multiple times not generating a valid object. Need to keep already processed bits of transactions stores and call more retries.