search

konveyor-ecosystem / kai

Konveyor AI - static code analysis driven migration to new targets via Generative AI
Apache License 2.0
8 stars 10 forks source link

Document using OpenAI API Compatible alternatives #186

Closed jmontleon closed 1 month ago

jwmatthews commented 1 month ago

@jmontleon good to merge this after the conflict is handled

jmontleon commented 1 month ago

@jwmatthews sounds good. I'm going to add a note about OpenShift AI using vLLM as well, since it is also OpenAI compatible. I'm still trying to test, but it's mostly some pain copying models around as well as some pain with istio and certs.

tl;dr the way istio does routes is not friendly with the cert-manager route operator so it's time consuming doing things manually. and last time i tried to use langchain with self-signed or invalid certs didn't go well.