The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.
Other
472
stars
42
forks
source link
llama_model.reset() Does Not Clear Context History (Phi-3 4k) #63
Description:
The llama_model.reset() method does not appear to clear the context history when using the Phi-3 4k model. This can lead to unexpected behavior in subsequent interactions.
Expected Behavior:
llama_model.reset() should clear all previous context, effectively resetting the model to its initial state.
Steps to Reproduce:
Load the Phi-3 4k model.
Have multiple interactions with the model.
Call llama_model.reset().
Observe that the model still references previous interactions.
Additional Information:
Description: The llama_model.reset() method does not appear to clear the context history when using the Phi-3 4k model. This can lead to unexpected behavior in subsequent interactions. Expected Behavior: llama_model.reset() should clear all previous context, effectively resetting the model to its initial state. Steps to Reproduce: