search

microsoft / autogen

A programming framework for agentic AI. Discord: https://aka.ms/autogen-dc. Roadmap: https://aka.ms/autogen-roadmap
https://microsoft.github.io/autogen/
Creative Commons Attribution 4.0 International
27.28k stars 3.97k forks source link

[Bug]: cant run local model #1949

Open HydraBucket opened 3 months ago

HydraBucket commented 3 months ago

Describe the bug

When attempting to setup an agent utilising a local LLM, I am told i need to reference an API key. Then when a false API key is referenced, the model still doesnt work.

I am running the LLMs through Ollama and locally hosting them on litellm. I am trying to follow the steps on this video, specifically the local LLM section - https://www.youtube.com/watch?v=mUEFwUU0IfE

Steps to reproduce

Follow the steps in this video.

https://www.youtube.com/watch?v=mUEFwUU0IfE

Model Used

llama2-13b and mistral

Expected Behavior

The LLM should become an option which can run on AutoGen

Screenshots and logs

Screenshot 2024-03-11 165704

Then when I attempt to use a false API the second screenshot happens

Screenshot 2024-03-11 165859

Below is the logs

(ag) C:\Users\Finn>autogenstudio ui --port 8081 INFO: Started server process [24804] INFO: Waiting for application startup. App started INFO: Application startup complete. INFO: Uvicorn running on http://127.0.0.1:8081 (Press CTRL+C to quit) INFO: 127.0.0.1:51439 - "GET / HTTP/1.1" 304 Not Modified INFO: 127.0.0.1:51439 - "GET /images/svgs/welcome.svg HTTP/1.1" 304 Not Modified INFO: 127.0.0.1:51439 - "GET /app-459ab408106051249ce7.js HTTP/1.1" 304 Not Modified INFO: 127.0.0.1:51439 - "GET /framework-0e118549f33203964972.js HTTP/1.1" 304 Not Modified INFO: 127.0.0.1:51440 - "GET /webpack-runtime-8ac8f64b53282ba8f2ef.js HTTP/1.1" 304 Not Modified INFO: 127.0.0.1:51440 - "GET /page-data/index/page-data.json HTTP/1.1" 304 Not Modified INFO: 127.0.0.1:51439 - "GET /6c05b3ab656a8bfc225a64b3d73a36a92f83c05e-2ded8b623c6b4983337a.js HTTP/1.1" 304 Not Modified INFO: 127.0.0.1:51440 - "GET /318ce576f236b79fd96f75904c13f6e55c3eee57-f6b02228d9af0addd9a7.js HTTP/1.1" 304 Not Modified INFO: 127.0.0.1:51457 - "GET /component---src-pages-index-tsx-1c73eed9173d78f95348.js HTTP/1.1" 304 Not Modified INFO: 127.0.0.1:51457 - "GET /sessions?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: 127.0.0.1:51440 - "GET /version HTTP/1.1" 200 OK INFO: 127.0.0.1:51457 - "GET /sessions?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: 127.0.0.1:51461 - "GET /manifest.webmanifest HTTP/1.1" 304 Not Modified INFO: ('127.0.0.1', 51463) - "WebSocket /ws/5a018213-9a8c-479f-8044-d36fdd480f4f" [accepted] New Connection: 5a018213-9a8c-479f-8044-d36fdd480f4f, Total: 1 INFO: 127.0.0.1:51457 - "GET /messages?user_id=guestuser@gmail.com&session_id=79338762-8536-4829-9187-ef425e1594ea HTTP/1.1" 200 OK INFO: connection open INFO: 127.0.0.1:51457 - "GET /messages?user_id=guestuser@gmail.com&session_id=79338762-8536-4829-9187-ef425e1594ea HTTP/1.1" 200 OK INFO: 127.0.0.1:51457 - "GET /page-data/build/page-data.json HTTP/1.1" 304 Not Modified Client #5a018213-9a8c-479f-8044-d36fdd480f4f is disconnected Connection Closed. Total: 0 INFO: connection closed INFO: 127.0.0.1:51457 - "GET /workflows?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: 127.0.0.1:51457 - "GET /page-data/gallery/page-data.json HTTP/1.1" 304 Not Modified INFO: 127.0.0.1:51457 - "GET /component---src-pages-gallery-index-tsx-5ff580b1b90969727553.js HTTP/1.1" 304 Not Modified INFO: 127.0.0.1:51457 - "GET /agents?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: 127.0.0.1:51457 - "GET /sessions?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: 127.0.0.1:51440 - "GET /messages?user_id=guestuser@gmail.com&session_id=79338762-8536-4829-9187-ef425e1594ea HTTP/1.1" 200 OK INFO: ('127.0.0.1', 51467) - "WebSocket /ws/5a018213-9a8c-479f-8044-d36fdd480f4f" [accepted] New Connection: 5a018213-9a8c-479f-8044-d36fdd480f4f, Total: 1 INFO: connection open INFO: 127.0.0.1:51440 - "GET /messages?user_id=guestuser@gmail.com&session_id=79338762-8536-4829-9187-ef425e1594ea HTTP/1.1" 200 OK INFO: 127.0.0.1:51440 - "GET /workflows?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: 127.0.0.1:51440 - "POST /sessions HTTP/1.1" 200 OK INFO: 127.0.0.1:51440 - "GET /messages?user_id=guestuser@gmail.com&session_id=4e94e893-5ee8-4ad6-a444-914cb0197206 HTTP/1.1" 200 OK Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\web\app.py", line 110, in add_message response_message: Message = managers["chat"].chat( ^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\chatmanager.py", line 62, in chat flow = AutoGenWorkFlowManager( ^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\workflowmanager.py", line 42, in init self.sender = self.load(config.sender) ^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\workflowmanager.py", line 201, in load agent = self.load_agent_config(agent_spec.config, agent_spec.type) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\workflowmanager.py", line 219, in load_agent_config agent = ExtendedConversableAgent( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\workflowmanager.py", line 244, in init super().init(*args, kwargs) File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\agentchat\conversable_agent.py", line 155, in init self.client = OpenAIWrapper(self.llm_config) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 373, in init self._register_default_client(config, openai_config) # could modify the config ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 426, in _register_default_client client = OpenAI(**openai_config) ^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_client.py", line 98, in init raise OpenAIError( openai.OpenAIError: The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY environment variable

INFO: 127.0.0.1:51440 - "POST /messages HTTP/1.1" 200 OK Client #5a018213-9a8c-479f-8044-d36fdd480f4f is disconnected Connection Closed. Total: 0 INFO: connection closed INFO: 127.0.0.1:51440 - "GET /workflows?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: 127.0.0.1:51440 - "GET /agents?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: 127.0.0.1:51440 - "GET /models?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: ('127.0.0.1', 51513) - "WebSocket /ws/5a018213-9a8c-479f-8044-d36fdd480f4f" [accepted] New Connection: 5a018213-9a8c-479f-8044-d36fdd480f4f, Total: 1 INFO: 127.0.0.1:51514 - "GET /sessions?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: connection open INFO: 127.0.0.1:51515 - "GET /messages?user_id=guestuser@gmail.com&session_id=4e94e893-5ee8-4ad6-a444-914cb0197206 HTTP/1.1" 200 OK INFO: 127.0.0.1:51515 - "GET /messages?user_id=guestuser@gmail.com&session_id=4e94e893-5ee8-4ad6-a444-914cb0197206 HTTP/1.1" 200 OK INFO: 127.0.0.1:51515 - "GET /workflows?user_id=guestuser@gmail.com HTTP/1.1" 200 OK Client #5a018213-9a8c-479f-8044-d36fdd480f4f is disconnected Connection Closed. Total: 0 INFO: connection closed INFO: 127.0.0.1:51515 - "GET /workflows?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: 127.0.0.1:51515 - "GET /agents?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: 127.0.0.1:51515 - "GET /agents?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: 127.0.0.1:51579 - "GET /models?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: 127.0.0.1:51631 - "GET /models?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: 127.0.0.1:51640 - "POST /workflows HTTP/1.1" 200 OK INFO: ('127.0.0.1', 51643) - "WebSocket /ws/5a018213-9a8c-479f-8044-d36fdd480f4f" [accepted] New Connection: 5a018213-9a8c-479f-8044-d36fdd480f4f, Total: 1 INFO: 127.0.0.1:51640 - "GET /sessions?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: connection open INFO: 127.0.0.1:51644 - "GET /messages?user_id=guestuser@gmail.com&session_id=4e94e893-5ee8-4ad6-a444-914cb0197206 HTTP/1.1" 200 OK INFO: 127.0.0.1:51644 - "GET /messages?user_id=guestuser@gmail.com&session_id=4e94e893-5ee8-4ad6-a444-914cb0197206 HTTP/1.1" 200 OK INFO: 127.0.0.1:51644 - "GET /workflows?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: 127.0.0.1:51644 - "POST /sessions HTTP/1.1" 200 OK INFO: 127.0.0.1:51644 - "GET /messages?user_id=guestuser@gmail.com&session_id=96af1791-ad11-4256-8089-80b4768263dd HTTP/1.1" 200 OK userproxy (to primary_assistant):

Hello

Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 69, in map_httpcore_exceptions yield File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 233, in handle_request resp = self._pool.handle_request(req) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection_pool.py", line 216, in handle_request raise exc from None File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection_pool.py", line 196, in handle_request response = connection.handle_request( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection.py", line 99, in handle_request raise exc File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection.py", line 76, in handle_request stream = self._connect(request) ^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection.py", line 122, in _connect stream = self._network_backend.connect_tcp(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_backends\sync.py", line 205, in connect_tcp with map_exceptions(exc_map): File "C:\Users\Finn\miniconda3\envs\ag\Lib\contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_exceptions.py", line 14, in map_exceptions raise to_exc(exc) from exc httpcore.ConnectError: [WinError 10049] The requested address is not valid in its context

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 918, in _request response = self._client.send( ^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 914, in send response = self._send_handling_auth( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 942, in _send_handling_auth response = self._send_handling_redirects( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 979, in _send_handling_redirects response = self._send_single_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 1015, in _send_single_request response = transport.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 232, in handle_request with map_httpcore_exceptions(): File "C:\Users\Finn\miniconda3\envs\ag\Lib\contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 86, in map_httpcore_exceptions raise mapped_exc(message) from exc httpx.ConnectError: [WinError 10049] The requested address is not valid in its context

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\web\app.py", line 110, in add_message response_message: Message = managers["chat"].chat( ^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\chatmanager.py", line 70, in chat flow.run(message=f"{message_text}", clear_history=False) File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\workflowmanager.py", line 235, in run self.sender.initiate_chat( File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\agentchat\conversable_agent.py", line 928, in initiate_chat self.send(self.generate_init_message(context), recipient, silent=silent) File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\agentchat\conversable_agent.py", line 620, in send recipient.receive(message, self, request_reply, silent) File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\workflowmanager.py", line 257, in receive super().receive(message, sender, request_reply, silent) File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\agentchat\conversable_agent.py", line 782, in receive reply = self.generate_reply(messages=self.chat_messages[sender], sender=sender) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\agentchat\conversable_agent.py", line 1784, in generate_reply final, reply = reply_func(self, messages=messages, sender=sender, config=reply_func_tuple["config"]) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\agentchat\conversable_agent.py", line 1181, in generate_oai_reply extracted_response = self._generate_oai_reply_from_client( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\agentchat\conversable_agent.py", line 1200, in _generate_oai_reply_from_client response = llm_client.create( ^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 624, in create response = client.create(params) ^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 278, in create response = completions.create(params) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_utils_utils.py", line 275, in wrapper return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai\resources\chat\completions.py", line 663, in create return self._post( ^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 1200, in post return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 889, in request return self._request( ^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 942, in _request return self._retry_request( ^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 1013, in _retry_request return self._request( ^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 942, in _request return self._retry_request( ^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 1013, in _retry_request return self._request( ^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 952, in _request raise APIConnectionError(request=request) from err openai.APIConnectionError: Connection error.

INFO: 127.0.0.1:51644 - "POST /messages HTTP/1.1" 200 OK Client #5a018213-9a8c-479f-8044-d36fdd480f4f is disconnected Connection Closed. Total: 0 INFO: connection closed INFO: 127.0.0.1:52265 - "GET /workflows?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: 127.0.0.1:52265 - "GET /agents?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: 127.0.0.1:52265 - "GET /models?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: 127.0.0.1:52281 - "POST /agents HTTP/1.1" 200 OK INFO: 127.0.0.1:52281 - "GET /models?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: 127.0.0.1:52311 - "POST /models HTTP/1.1" 200 OK Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\web\app.py", line 442, in test_user_models response = test_model(model=req.model) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\utils\utils.py", line 408, in test_model client = OpenAIWrapper(config_list=[sanitized_model]) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 373, in init self._register_default_client(config, openai_config) # could modify the config ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 426, in _register_default_client client = OpenAI(**openai_config) ^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_client.py", line 98, in init raise OpenAIError( openai.OpenAIError: The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY environment variable

INFO: 127.0.0.1:52311 - "POST /models/test HTTP/1.1" 200 OK Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\web\app.py", line 442, in test_user_models response = test_model(model=req.model) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\utils\utils.py", line 408, in test_model client = OpenAIWrapper(config_list=[sanitized_model]) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 373, in init self._register_default_client(config, openai_config) # could modify the config ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 426, in _register_default_client client = OpenAI(**openai_config) ^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_client.py", line 98, in init raise OpenAIError( openai.OpenAIError: The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY environment variable

INFO: 127.0.0.1:60219 - "POST /models/test HTTP/1.1" 200 OK Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\web\app.py", line 442, in test_user_models response = test_model(model=req.model) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\utils\utils.py", line 408, in test_model client = OpenAIWrapper(config_list=[sanitized_model]) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 373, in init self._register_default_client(config, openai_config) # could modify the config ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 426, in _register_default_client client = OpenAI(**openai_config) ^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_client.py", line 98, in init raise OpenAIError( openai.OpenAIError: The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY environment variable

INFO: 127.0.0.1:60269 - "POST /models/test HTTP/1.1" 200 OK Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\web\app.py", line 442, in test_user_models response = test_model(model=req.model) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\utils\utils.py", line 408, in test_model client = OpenAIWrapper(config_list=[sanitized_model]) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 373, in init self._register_default_client(config, openai_config) # could modify the config ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 426, in _register_default_client client = OpenAI(**openai_config) ^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_client.py", line 98, in init raise OpenAIError( openai.OpenAIError: The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY environment variable

INFO: 127.0.0.1:60269 - "POST /models/test HTTP/1.1" 200 OK Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\web\app.py", line 442, in test_user_models response = test_model(model=req.model) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\utils\utils.py", line 408, in test_model client = OpenAIWrapper(config_list=[sanitized_model]) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 373, in init self._register_default_client(config, openai_config) # could modify the config ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 426, in _register_default_client client = OpenAI(**openai_config) ^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_client.py", line 98, in init raise OpenAIError( openai.OpenAIError: The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY environment variable

INFO: 127.0.0.1:60269 - "POST /models/test HTTP/1.1" 200 OK Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 69, in map_httpcore_exceptions yield File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 233, in handle_request resp = self._pool.handle_request(req) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection_pool.py", line 216, in handle_request raise exc from None File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection_pool.py", line 196, in handle_request response = connection.handle_request( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection.py", line 99, in handle_request raise exc File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection.py", line 76, in handle_request stream = self._connect(request) ^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection.py", line 122, in _connect stream = self._network_backend.connect_tcp(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_backends\sync.py", line 205, in connect_tcp with map_exceptions(exc_map): File "C:\Users\Finn\miniconda3\envs\ag\Lib\contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_exceptions.py", line 14, in map_exceptions raise to_exc(exc) from exc httpcore.ConnectError: [WinError 10049] The requested address is not valid in its context

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 918, in _request response = self._client.send( ^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 914, in send response = self._send_handling_auth( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 942, in _send_handling_auth response = self._send_handling_redirects( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 979, in _send_handling_redirects response = self._send_single_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 1015, in _send_single_request response = transport.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 232, in handle_request with map_httpcore_exceptions(): File "C:\Users\Finn\miniconda3\envs\ag\Lib\contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 86, in map_httpcore_exceptions raise mapped_exc(message) from exc httpx.ConnectError: [WinError 10049] The requested address is not valid in its context

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\web\app.py", line 442, in test_user_models response = test_model(model=req.model) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\utils\utils.py", line 409, in test_model response = client.create(messages=[{"role": "user", "content": "2+2="}], cache_seed=None) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 624, in create response = client.create(params) ^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 278, in create response = completions.create(*params) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_utils_utils.py", line 275, in wrapper return func(args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai\resources\chat\completions.py", line 663, in create return self._post( ^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 1200, in post return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 889, in request return self._request( ^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 942, in _request return self._retry_request( ^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 1013, in _retry_request return self._request( ^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 942, in _request return self._retry_request( ^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 1013, in _retry_request return self._request( ^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 952, in _request raise APIConnectionError(request=request) from err openai.APIConnectionError: Connection error.

INFO: 127.0.0.1:60554 - "POST /models/test HTTP/1.1" 200 OK Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 69, in map_httpcore_exceptions yield File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 233, in handle_request resp = self._pool.handle_request(req) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection_pool.py", line 216, in handle_request raise exc from None File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection_pool.py", line 196, in handle_request response = connection.handle_request( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection.py", line 99, in handle_request raise exc File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection.py", line 76, in handle_request stream = self._connect(request) ^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection.py", line 122, in _connect stream = self._network_backend.connect_tcp(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_backends\sync.py", line 205, in connect_tcp with map_exceptions(exc_map): File "C:\Users\Finn\miniconda3\envs\ag\Lib\contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_exceptions.py", line 14, in map_exceptions raise to_exc(exc) from exc httpcore.ConnectError: [WinError 10049] The requested address is not valid in its context

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 918, in _request response = self._client.send( ^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 914, in send response = self._send_handling_auth( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 942, in _send_handling_auth response = self._send_handling_redirects( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 979, in _send_handling_redirects response = self._send_single_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 1015, in _send_single_request response = transport.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 232, in handle_request with map_httpcore_exceptions(): File "C:\Users\Finn\miniconda3\envs\ag\Lib\contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 86, in map_httpcore_exceptions raise mapped_exc(message) from exc httpx.ConnectError: [WinError 10049] The requested address is not valid in its context

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\web\app.py", line 442, in test_user_models response = test_model(model=req.model) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\utils\utils.py", line 409, in test_model response = client.create(messages=[{"role": "user", "content": "2+2="}], cache_seed=None) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 624, in create response = client.create(params) ^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 278, in create response = completions.create(*params) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_utils_utils.py", line 275, in wrapper return func(args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai\resources\chat\completions.py", line 663, in create return self._post( ^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 1200, in post return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 889, in request return self._request( ^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 942, in _request return self._retry_request( ^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 1013, in _retry_request return self._request( ^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 942, in _request return self._retry_request( ^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 1013, in _retry_request return self._request( ^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 952, in _request raise APIConnectionError(request=request) from err openai.APIConnectionError: Connection error.

INFO: 127.0.0.1:60620 - "POST /models/test HTTP/1.1" 200 OK

Additional Information

No response

victordibia commented 3 months ago

Hi @HydraBucket ,

It looks like you may be using the wrong base url ... can you change it from http://0.0.0.0:4000 to http://0.0.0.0:4000/v1.

Note the v1 at the end.

To learn more, please see the Ollama docs on that here.

image

https://ollama.com/blog/openai-compatibility

HydraBucket commented 3 months ago

Thank you for your help, I've added in the V1 to my model's information and as per the link you sent me, I added the api key "Ollama" to my mistral description. I am now receiving a different error

image

INFO: 127.0.0.1:53679 - "POST /messages HTTP/1.1" 200 OK INFO: 127.0.0.1:53697 - "GET /workflows?user_id=guestuser@gmail.com HTTP/1.1" 200 OK Client #cf55afb7-4bdb-4136-b3f0-5e24ef5343b5 is disconnected Connection Closed. Total: 0 INFO: connection closed INFO: 127.0.0.1:53697 - "GET /workflows?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: 127.0.0.1:53697 - "GET /agents?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: 127.0.0.1:53697 - "GET /agents?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: 127.0.0.1:63817 - "GET /models?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: 127.0.0.1:63822 - "GET /models?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: 127.0.0.1:63836 - "POST /workflows HTTP/1.1" 200 OK INFO: 127.0.0.1:63836 - "GET /sessions?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: ('127.0.0.1', 63843) - "WebSocket /ws/cf55afb7-4bdb-4136-b3f0-5e24ef5343b5" [accepted] New Connection: cf55afb7-4bdb-4136-b3f0-5e24ef5343b5, Total: 1 INFO: 127.0.0.1:63844 - "GET /messages?user_id=guestuser@gmail.com&session_id=79338762-8536-4829-9187-ef425e1594ea HTTP/1.1" 200 OK INFO: connection open INFO: 127.0.0.1:63845 - "GET /messages?user_id=guestuser@gmail.com&session_id=96af1791-ad11-4256-8089-80b4768263dd HTTP/1.1" 200 OK INFO: 127.0.0.1:63845 - "GET /messages?user_id=guestuser@gmail.com&session_id=96af1791-ad11-4256-8089-80b4768263dd HTTP/1.1" 200 OK INFO: 127.0.0.1:63845 - "GET /workflows?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: 127.0.0.1:63845 - "POST /sessions HTTP/1.1" 200 OK INFO: 127.0.0.1:63845 - "GET /messages?user_id=guestuser@gmail.com&session_id=7ecf6c64-f1ef-4ec9-834e-77855b5e9c0e HTTP/1.1" 200 OK userproxy (to primary_assistant):

Test

Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 69, in map_httpcore_exceptions yield File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 233, in handle_request resp = self._pool.handle_request(req) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection_pool.py", line 216, in handle_request raise exc from None File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection_pool.py", line 196, in handle_request response = connection.handle_request( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection.py", line 99, in handle_request raise exc File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection.py", line 76, in handle_request stream = self._connect(request) ^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection.py", line 122, in _connect stream = self._network_backend.connect_tcp(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_backends\sync.py", line 205, in connect_tcp with map_exceptions(exc_map): File "C:\Users\Finn\miniconda3\envs\ag\Lib\contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_exceptions.py", line 14, in map_exceptions raise to_exc(exc) from exc httpcore.ConnectError: [WinError 10049] The requested address is not valid in its context

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 918, in _request response = self._client.send( ^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 914, in send response = self._send_handling_auth( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 942, in _send_handling_auth response = self._send_handling_redirects( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 979, in _send_handling_redirects response = self._send_single_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 1015, in _send_single_request response = transport.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 232, in handle_request with map_httpcore_exceptions(): File "C:\Users\Finn\miniconda3\envs\ag\Lib\contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 86, in map_httpcore_exceptions raise mapped_exc(message) from exc httpx.ConnectError: [WinError 10049] The requested address is not valid in its context

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\web\app.py", line 110, in add_message response_message: Message = managers["chat"].chat( ^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\chatmanager.py", line 70, in chat flow.run(message=f"{message_text}", clear_history=False) File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\workflowmanager.py", line 235, in run self.sender.initiate_chat( File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\agentchat\conversable_agent.py", line 928, in initiate_chat self.send(self.generate_init_message(context), recipient, silent=silent) File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\agentchat\conversable_agent.py", line 620, in send recipient.receive(message, self, request_reply, silent) File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\workflowmanager.py", line 257, in receive super().receive(message, sender, request_reply, silent) File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\agentchat\conversable_agent.py", line 782, in receive reply = self.generate_reply(messages=self.chat_messages[sender], sender=sender) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\agentchat\conversable_agent.py", line 1784, in generate_reply final, reply = reply_func(self, messages=messages, sender=sender, config=reply_func_tuple["config"]) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\agentchat\conversable_agent.py", line 1181, in generate_oai_reply extracted_response = self._generate_oai_reply_from_client( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\agentchat\conversable_agent.py", line 1200, in _generate_oai_reply_from_client response = llm_client.create( ^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 624, in create response = client.create(params) ^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 278, in create response = completions.create(params) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_utils_utils.py", line 275, in wrapper return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai\resources\chat\completions.py", line 663, in create return self._post( ^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 1200, in post return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 889, in request return self._request( ^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 942, in _request return self._retry_request( ^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 1013, in _retry_request return self._request( ^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 942, in _request return self._retry_request( ^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 1013, in _retry_request return self._request( ^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 952, in _request raise APIConnectionError(request=request) from err openai.APIConnectionError: Connection error.

INFO: 127.0.0.1:63845 - "POST /messages HTTP/1.1" 200 OK Client #cf55afb7-4bdb-4136-b3f0-5e24ef5343b5 is disconnected Connection Closed. Total: 0 INFO: connection closed INFO: 127.0.0.1:63986 - "GET /workflows?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: 127.0.0.1:63986 - "GET /agents?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: 127.0.0.1:63993 - "GET /models?user_id=guestuser@gmail.com HTTP/1.1" 200 OK INFO: 127.0.0.1:63993 - "GET /models?user_id=guestuser@gmail.com HTTP/1.1" 200 OK Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 69, in map_httpcore_exceptions yield File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 233, in handle_request resp = self._pool.handle_request(req) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection_pool.py", line 216, in handle_request raise exc from None File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection_pool.py", line 196, in handle_request response = connection.handle_request( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection.py", line 99, in handle_request raise exc File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection.py", line 76, in handle_request stream = self._connect(request) ^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection.py", line 122, in _connect stream = self._network_backend.connect_tcp(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_backends\sync.py", line 205, in connect_tcp with map_exceptions(exc_map): File "C:\Users\Finn\miniconda3\envs\ag\Lib\contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_exceptions.py", line 14, in map_exceptions raise to_exc(exc) from exc httpcore.ConnectError: [WinError 10049] The requested address is not valid in its context

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 918, in _request response = self._client.send( ^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 914, in send response = self._send_handling_auth( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 942, in _send_handling_auth response = self._send_handling_redirects( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 979, in _send_handling_redirects response = self._send_single_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 1015, in _send_single_request response = transport.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 232, in handle_request with map_httpcore_exceptions(): File "C:\Users\Finn\miniconda3\envs\ag\Lib\contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 86, in map_httpcore_exceptions raise mapped_exc(message) from exc httpx.ConnectError: [WinError 10049] The requested address is not valid in its context

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\web\app.py", line 442, in test_user_models response = test_model(model=req.model) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\utils\utils.py", line 409, in test_model response = client.create(messages=[{"role": "user", "content": "2+2="}], cache_seed=None) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 624, in create response = client.create(params) ^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 278, in create response = completions.create(*params) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_utils_utils.py", line 275, in wrapper return func(args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai\resources\chat\completions.py", line 663, in create return self._post( ^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 1200, in post return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 889, in request return self._request( ^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 942, in _request return self._retry_request( ^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 1013, in _retry_request return self._request( ^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 942, in _request return self._retry_request( ^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 1013, in _retry_request return self._request( ^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 952, in _request raise APIConnectionError(request=request) from err openai.APIConnectionError: Connection error.

INFO: 127.0.0.1:64008 - "POST /models/test HTTP/1.1" 200 OK Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\web\app.py", line 442, in test_user_models response = test_model(model=req.model) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\utils\utils.py", line 408, in test_model client = OpenAIWrapper(config_list=[sanitized_model]) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 373, in init self._register_default_client(config, openai_config) # could modify the config ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 426, in _register_default_client client = OpenAI(**openai_config) ^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_client.py", line 98, in init raise OpenAIError( openai.OpenAIError: The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY environment variable

INFO: 127.0.0.1:64044 - "POST /models/test HTTP/1.1" 200 OK Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 69, in map_httpcore_exceptions yield File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 233, in handle_request resp = self._pool.handle_request(req) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection_pool.py", line 216, in handle_request raise exc from None File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection_pool.py", line 196, in handle_request response = connection.handle_request( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection.py", line 99, in handle_request raise exc File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection.py", line 76, in handle_request stream = self._connect(request) ^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection.py", line 122, in _connect stream = self._network_backend.connect_tcp(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_backends\sync.py", line 205, in connect_tcp with map_exceptions(exc_map): File "C:\Users\Finn\miniconda3\envs\ag\Lib\contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_exceptions.py", line 14, in map_exceptions raise to_exc(exc) from exc httpcore.ConnectError: [WinError 10049] The requested address is not valid in its context

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 918, in _request response = self._client.send( ^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 914, in send response = self._send_handling_auth( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 942, in _send_handling_auth response = self._send_handling_redirects( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 979, in _send_handling_redirects response = self._send_single_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 1015, in _send_single_request response = transport.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 232, in handle_request with map_httpcore_exceptions(): File "C:\Users\Finn\miniconda3\envs\ag\Lib\contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 86, in map_httpcore_exceptions raise mapped_exc(message) from exc httpx.ConnectError: [WinError 10049] The requested address is not valid in its context

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\web\app.py", line 442, in test_user_models response = test_model(model=req.model) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\utils\utils.py", line 409, in test_model response = client.create(messages=[{"role": "user", "content": "2+2="}], cache_seed=None) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 624, in create response = client.create(params) ^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 278, in create response = completions.create(*params) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_utils_utils.py", line 275, in wrapper return func(args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai\resources\chat\completions.py", line 663, in create return self._post( ^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 1200, in post return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 889, in request return self._request( ^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 942, in _request return self._retry_request( ^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 1013, in _retry_request return self._request( ^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 942, in _request return self._retry_request( ^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 1013, in _retry_request return self._request( ^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 952, in _request raise APIConnectionError(request=request) from err openai.APIConnectionError: Connection error.

INFO: 127.0.0.1:64140 - "POST /models/test HTTP/1.1" 200 OK Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 69, in map_httpcore_exceptions yield File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 233, in handle_request resp = self._pool.handle_request(req) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection_pool.py", line 216, in handle_request raise exc from None File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection_pool.py", line 196, in handle_request response = connection.handle_request( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection.py", line 99, in handle_request raise exc File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection.py", line 76, in handle_request stream = self._connect(request) ^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection.py", line 122, in _connect stream = self._network_backend.connect_tcp(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_backends\sync.py", line 205, in connect_tcp with map_exceptions(exc_map): File "C:\Users\Finn\miniconda3\envs\ag\Lib\contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_exceptions.py", line 14, in map_exceptions raise to_exc(exc) from exc httpcore.ConnectError: [WinError 10049] The requested address is not valid in its context

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 918, in _request response = self._client.send( ^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 914, in send response = self._send_handling_auth( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 942, in _send_handling_auth response = self._send_handling_redirects( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 979, in _send_handling_redirects response = self._send_single_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 1015, in _send_single_request response = transport.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 232, in handle_request with map_httpcore_exceptions(): File "C:\Users\Finn\miniconda3\envs\ag\Lib\contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 86, in map_httpcore_exceptions raise mapped_exc(message) from exc httpx.ConnectError: [WinError 10049] The requested address is not valid in its context

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\web\app.py", line 442, in test_user_models response = test_model(model=req.model) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\utils\utils.py", line 409, in test_model response = client.create(messages=[{"role": "user", "content": "2+2="}], cache_seed=None) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 624, in create response = client.create(params) ^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 278, in create response = completions.create(*params) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_utils_utils.py", line 275, in wrapper return func(args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai\resources\chat\completions.py", line 663, in create return self._post( ^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 1200, in post return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 889, in request return self._request( ^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 942, in _request return self._retry_request( ^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 1013, in _retry_request return self._request( ^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 942, in _request return self._retry_request( ^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 1013, in _retry_request return self._request( ^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 952, in _request raise APIConnectionError(request=request) from err openai.APIConnectionError: Connection error.

INFO: 127.0.0.1:64160 - "POST /models/test HTTP/1.1" 200 OK Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 69, in map_httpcore_exceptions yield File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 233, in handle_request resp = self._pool.handle_request(req) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection_pool.py", line 216, in handle_request raise exc from None File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection_pool.py", line 196, in handle_request response = connection.handle_request( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection.py", line 99, in handle_request raise exc File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection.py", line 76, in handle_request stream = self._connect(request) ^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_sync\connection.py", line 122, in _connect stream = self._network_backend.connect_tcp(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_backends\sync.py", line 205, in connect_tcp with map_exceptions(exc_map): File "C:\Users\Finn\miniconda3\envs\ag\Lib\contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpcore_exceptions.py", line 14, in map_exceptions raise to_exc(exc) from exc httpcore.ConnectError: [WinError 10049] The requested address is not valid in its context

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 918, in _request response = self._client.send( ^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 914, in send response = self._send_handling_auth( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 942, in _send_handling_auth response = self._send_handling_redirects( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 979, in _send_handling_redirects response = self._send_single_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_client.py", line 1015, in _send_single_request response = transport.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 232, in handle_request with map_httpcore_exceptions(): File "C:\Users\Finn\miniconda3\envs\ag\Lib\contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\httpx_transports\default.py", line 86, in map_httpcore_exceptions raise mapped_exc(message) from exc httpx.ConnectError: [WinError 10049] The requested address is not valid in its context

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\web\app.py", line 442, in test_user_models response = test_model(model=req.model) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogenstudio\utils\utils.py", line 409, in test_model response = client.create(messages=[{"role": "user", "content": "2+2="}], cache_seed=None) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 624, in create response = client.create(params) ^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\autogen\oai\client.py", line 278, in create response = completions.create(*params) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_utils_utils.py", line 275, in wrapper return func(args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai\resources\chat\completions.py", line 663, in create return self._post( ^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 1200, in post return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 889, in request return self._request( ^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 942, in _request return self._retry_request( ^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 1013, in _retry_request return self._request( ^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 942, in _request return self._retry_request( ^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 1013, in _retry_request return self._request( ^^^^^^^^^^^^^^ File "C:\Users\Finn\miniconda3\envs\ag\Lib\site-packages\openai_base_client.py", line 952, in _request raise APIConnectionError(request=request) from err openai.APIConnectionError: Connection error.

INFO: 127.0.0.1:64167 - "POST /models/test HTTP/1.1" 200 OK

HarrisonMulderSkyboxLabs commented 4 weeks ago

I get the same issue. Repro steps:

(fresh installs as of May 16 2024)

Would appreciate an answer on this, because this seems like the most basic use-case for getting Autogen Studio up and running using local LLMs, no?

(Side note: I've tried hosting with LM Studio instead of litellm but there's an issue with LM Studio where each message is only 1-2 words long and it's impossible to get agents to complete tasks that way)

HarrisonMulderSkyboxLabs commented 4 weeks ago

Just an update here. It seems like replacing the "0.0.0.0" with "localhost" worked.

HydraBucket commented 4 weeks ago

Awesome! Thanks. Will dust off the application and attempt again.