search

drizzle-mizzle / Character-Engine-Discord

(not yet very) Ultimate LLMs aggregator right in your Discord server
https://discord.gg/JtVzgJ8Znh
GNU General Public License v3.0
110 stars 48 forks source link

koboldParams all being passed as float #18

Open zifnub opened 10 months ago

zifnub commented 10 months ago

When trying out the kobold api I'm getting this on koboldccp:

"rep_pen": 1.05, "rep_pen_slope": 0.8, "singleline": false, "temperature": 1.07, "tfs": 0.93, "top_a": 0.0, "top_k": 100.0, "top_P": 1.0, "typical": 1.0} int expected instead of float

I'm not sure which one it's complaining about but I'm assuming top_k.

cha0sbuster commented 7 months ago

Yep, it's top_k. In Models/KoboldAI/KoboldAiRequestParams.cs, change Line 13 to say int instead of float, redo the build, and it works.

zifnub commented 7 months ago

Thanks! I gave that a try and it works now.