Currently, Character Engine is passing all sampling parameters as float, but KoboldAI expects an int for TopK (see #18)
This fix allows for very basic KoboldAI support, albeit without e.g. parameter adjustment which obviously still needs implementing.
Currently, Character Engine is passing all sampling parameters as
float,
but KoboldAI expects anint
forTopK
(see #18) This fix allows for very basic KoboldAI support, albeit without e.g. parameter adjustment which obviously still needs implementing.