Add native Ollama support to enable model options

EveripediaNetwork / issues

Issues repo

9 stars 0 forks source link

Add native Ollama support to enable model options #2693

Closed brunneis closed 4 months ago

brunneis commented 4 months ago

Ollama's compatible OpenAI API does not support parameters. To enable custom context sizes for models such as llama3-gradient, the native API must be used.

brunneis commented 4 months ago

https://github.com/EveripediaNetwork/iq-code-cortex/pull/60