Open theinhumaneme opened 6 months ago
It would be great if we have this implementation to reduce the API costs while passing the Conversation to the LLM while passing only the relevant history.
Greate!
will this feature be worked upon? as sending the entire chat history which could possibly be a a few hundred messages be a very expensive undertaking
It would be great if we have this implementation to reduce the API costs while passing the Conversation to the LLM while passing only the relevant history.