Closed UdaraJay closed 4 months ago
This doesn't work as intended at the moment because the OpenAI SDK sends some analytics headers x-stainess-*
that the local Ollama API rejects (CORS). Need to fix this at some point with either a built-in thin proxy to get past this or finding a way to configure CORS in Ollama or using the ollamajs lib when ollama is configured.
Hoping this use-case could be supported on the Ollama end as well. https://github.com/ollama/ollama/issues/4388