search

kyegomez / tree-of-thoughts

Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%
https://discord.gg/qUtxnK2NMf
Apache License 2.0
4.18k stars 353 forks source link

can we not use api of openai, but local vicuna instead? #4

Closed 1lifetime1 closed 1 year ago

kyegomez commented 1 year ago

Yes, of course let's make a class together, we can use the majority of the OpenAI Class but we'll have to change the api call to the weights initialization

yhyu13 commented 1 year ago

@kyegomez probably we just go with Langchain or whatever that abstract LLMs models

yhyu13 commented 1 year ago

A pr on this https://github.com/kyegomez/tree-of-thoughts/pull/8, it uses ooba's textgen webui as server.

kyegomez commented 1 year ago

@yhyu13

Yeah Let's make an langchain class

kyegomez commented 1 year ago

And @1lifetime1 help build the class for vicuna!