Open erskine opened 1 year ago
Set things up so that the chatbot code (http listener live loop) can invoke the model and get responses back.
Set up http listener job that can accept requests, invoke the llm, and return responses
Set things up so that the chatbot code (http listener live loop) can invoke the model and get responses back.