konveyor-ecosystem / kai

Konveyor AI - static code analysis driven migration to new targets via Generative AI
Apache License 2.0
8 stars 10 forks source link

Update IBM / OpenSource default values #141

Closed jmontleon closed 2 months ago

jmontleon commented 2 months ago

Juanma stated that the results improved after making these changes in combination with prompt changes. https://github.com/konveyor-ecosystem/coolstore/pull/19

temperature 0.05 is the minimum IBM accepts and will probably generally result in more reproducible results, but open to discussing adjusting any of these.

JonahSussman commented 2 months ago

LGTM

Just wondering, in the long-term would we want individual models to be tuned differently, or do we expect these parameters to perform better across the board? if the former, maybe we want preconfigured arg blocks for models we want to support in the config.toml

@fabianvf +1 to this idea. Setting the defaults is great, but using the args dictionary is better