konveyor-ecosystem / kai

Konveyor AI - static code analysis driven migration to new targets via Generative AI
Apache License 2.0
8 stars 10 forks source link

Update configuration so a user may add in arbitrary coordinates for a LLM of their choice. #164

Open jwmatthews opened 2 months ago

jwmatthews commented 2 months ago

As of early April 2024 we are limiting the choices a user may choose for a model to be based on models available from IBM's BAM service or OpenAI.

We want to provide a means that users may configure arbitrary coordinates for a LLM service so they can test with any LLM of their choice.

I assume this means we need to open up the Model Provider a little so we can overwrite endpoints at a minimum

jwmatthews commented 2 months ago

Related to #148