eyurtsev / kor

LLM(😽)
https://eyurtsev.github.io/kor/
MIT License
1.57k stars 88 forks source link

Dose Kor support open source model #263

Closed gouse95 closed 4 months ago

gouse95 commented 4 months ago

If it supports open source LLM's please provide list of models

eyurtsev commented 4 months ago

It uses a prompt based technique rather than function calling or JSON mode, so it basically works with any language or chat model. Look at langchain documentation to identify which models you might be able to use.

Quality of results depends on the prompt and on the LLMs used (see guidelines in documentation)