search

tidyverse / elmer

Call LLM APIs from R
http://elmer.tidyverse.org/
Other
199 stars 28 forks source link

Consider not saving chat history #130

Closed JamesHWade closed 1 month ago

JamesHWade commented 1 month ago

This is a similar thought to #29, but maybe a bit easier to implement. In some cases, we may want to make repeated API calls without saving the history for each call. An example is Edgar Ruiz's mall package.

Preserving the usage monitoring but removing the history would be nice. What about adding a save_history param to chat()?

hadley commented 1 month ago

For now, I'd recommend setting up a base chat object and then calling $clone() before you start chatting. I'm not sure what this interface will look like long term, but it's also likely to be connected to caching (#107)