search

xebia-functional / xef

Building applications with LLMs through composability, in Kotlin, Scala, ...
https://xef.ai
Apache License 2.0
174 stars 15 forks source link

Enum/Classification support for models that do not support `logitBias` #746

Open raulraja opened 3 months ago

raulraja commented 3 months ago

This pull request adds support to work with enums and classification for models that do not have the logitBias property. It also includes an example using Ollama's Gemma 2B model.