guidance: improve cache handling, add usage / cost details - Githubissues

whiletrue-industries / odds

ckangpt

MIT License

1 stars 0 forks source link

guidance: improve cache handling, add usage / cost details #24

Closed OriHoch closed 1 year ago

OriHoch commented 1 year ago

fixed a problem with cache handling because caching was handled before replacement of context, causing inconsistent results
add usage/cost details