local openai API compatibility

JHubi1 / ollama-app

A modern and easy-to-use client for Ollama

Apache License 2.0

241 stars 17 forks source link

local openai API compatibility #2

Closed shammyfiveducks closed 1 month ago

shammyfiveducks commented 1 month ago

Suggestion: Adding openai API compatibility would be much appreciated.

E.g localhost:port/v1

/models

Etc

open it up to connecting to the powerhouses: llamacpp, localllm and the rest of the local llm openai api supporting software

Cheers

JHubi1 commented 1 month ago

This might happen in the distant future, but is definitely not a main target. You should take a look into Ollama, it's the most popular local AI system.