⚡ Edgen: Local, private GenAI server alternative to OpenAI. No GPU required. Run AI models locally: LLMs (Llama2, Mistral, Mixtral...), Speech-to-text (whisper) and many others.
Some requests don't require a session to be kept. A new optional parameter should be added to chat completions that will keep the new LLM context from being saved.
Some requests don't require a session to be kept. A new optional parameter should be added to chat completions that will keep the new LLM context from being saved.