Template 'mistralai/mixtral-8x7b-instruct-v01' not found. Falling back to main.jinja

konveyor-ecosystem / kai

Konveyor AI - static code analysis driven migration to new targets via Generative AI

Apache License 2.0

8 stars 10 forks source link

Template 'mistralai/mixtral-8x7b-instruct-v01' not found. Falling back to main.jinja #210

Open jwmatthews opened 2 days ago

jwmatthews commented 2 days ago

We currently do not have specialized templates for most models, so it is normal and expected to see the below, yet we are logging this as an ERROR which will be misleading and confusing to new users.

ERROR - 2024-06-26 06:22:09,278 - [ llm_io_handler.py:84 - get_prompt()] - Template 'mistralai/mixtral-8x7b-instruct-v01' not found. Falling back to main.jinja

We should change the logging level to be something other than error

gtyellow commented 2 days ago

I'd like to take this on as my first issue.

jwmatthews commented 2 days ago

@gtyellow sounds great, if you run into questions getting Kai running locally let us know.