Connection to Text Generation WebUI

QuangBK / localLLM_guidance

Local LLM ReAct Agent with Guidance

151 stars 24 forks source link

Closed schauppi closed 11 months ago

schauppi commented 1 year ago

Hey,

Do you know if it‘s possible to connect guidance to hosted models in the Text Generation WebUI Server?

Thx!

QuangBK commented 1 year ago

Hi, I think you should check this PR https://github.com/microsoft/guidance/pull/221. I hope it helps you.