search

composable-models / llm_multiagent_debate

ICML 2024: Improving Factuality and Reasoning in Language Models through Multiagent Debate
304 stars 42 forks source link

How to use Open Source LLM for LLM Multi Agent Debate? #3

Open jbdatascience opened 1 year ago

jbdatascience commented 1 year ago

I would like to be able to use Open Source LLM for LLM Multi Agent. How could I do that, for example with Falcon 7B (or even Falcon 40B)?

yilundu commented 1 year ago

Hi -- you can existing tools online to set up a API like the OpenAI API and then run the other language models

2018211801 commented 9 months ago

Hi -- you can existing tools online to set up a API like the OpenAI API and then run the other language models

Is fastapi useful for setting up api? Why does it have to be an API and cannot be called directly？ Thanks!