Open Dillon-G opened 1 year ago
UML Diagram
Use-Case
Sequential with and without background
Without Background
With Background
For info on refinement, data was planned to be stored in such a way that the chatbot would be able to access what the user and bot had previously messaged. Refinement was needed when it was discovered storing too many tokens can very easily ramp up costs on OpenAI, leading to the decision to limit the ChatBot's memory to about 1000-2000 tokens, which is about the equivalent to 4000-8000 characters. Still a good memory but not unlimited which will lead to memory loss.