search

yeyu2 / Youtube_demos

157 stars 64 forks source link

Local LLM and Autogen #1

Open Foolafroos opened 11 months ago

Foolafroos commented 11 months ago

Hello Everyone !

Did you try to make it run on a local Setup ?

I tried by replacing the Configlist by a local one

create the Configuration of your environnement

config_list = [ { "api_type": "open_ai", "api_base": "http://localhost:1234/v1", "api_key": "NULL", }, ]

and replacing all the gpt4_config instance by llm_config=llm_config, .

I am having api issue. not surprising... but i was wondering if you already made it run with a local LLM and if you had any tips if so?

Thanks ! Discovered Panel trhough your video btw :)

aaronson2012 commented 11 months ago

its "base_url" not "api_base". also i dont think you need "api_type"