microsoft / TaskWeaver

A code-first agent framework for seamlessly planning and executing data analytics tasks.
https://microsoft.github.io/TaskWeaver/
MIT License
5.31k stars 671 forks source link

unable to run with lm studio #72

Open POWERFULMOVES opened 10 months ago

POWERFULMOVES commented 10 months ago

Describe the bug my current config to access lm studio

{ "llm.api_base": "http://localhost:1234/v1", "llm.api_key": "0", "llm.model": "local-model", "llm.response_format": null }

i get this error

Error: Cannot process your request due to Exception: OpenAI API request failed to connect: Connection error. Traceback (most recent call last): File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_exceptions.py", line 10, in map_exceptions yield File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/http11.py", line 130, in _send_request_headers event = h11.Request( ^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/h11/_events.py", line 96, in init self, "headers", normalize_and_validate(headers, _parsed=_parsed) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/h11/_headers.py", line 164, in normalize_and_validate validate(_field_value_re, value, "Illegal header value {!r}", value) File "/home/vscode/.local/lib/python3.11/site-packages/h11/_util.py", line 91, in validate raise LocalProtocolError(msg) h11._util.LocalProtocolError: Illegal header value b'Bearer '

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 60, in map_httpcore_exceptions yield File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 218, in handle_request resp = self._pool.handle_request(req) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection_pool.py", line 262, in handle_request raise exc File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection_pool.py", line 245, in handle_request response = connection.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection.py", line 96, in handle_request return self._connection.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/http11.py", line 121, in handle_request raise exc File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/http11.py", line 88, in handle_request self._send_request_headers(**kwargs) File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/http11.py", line 129, in _send_request_headers with map_exceptions({h11.LocalProtocolError: LocalProtocolError}): File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions raise to_exc(exc) from exc httpcore.LocalProtocolError: Illegal header value b'Bearer '

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 877, in _request response = self._client.send( ^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 901, in send response = self._send_handling_auth( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 929, in _send_handling_auth response = self._send_handling_redirects( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 966, in _send_handling_redirects response = self._send_single_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 1002, in _send_single_request response = transport.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 217, in handle_request with map_httpcore_exceptions(): File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 77, in map_httpcore_exceptions raise mapped_exc(message) from exc httpx.LocalProtocolError: Illegal header value b'Bearer '

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_exceptions.py", line 10, in map_exceptions yield File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/http11.py", line 130, in _send_request_headers event = h11.Request( ^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/h11/_events.py", line 96, in init self, "headers", normalize_and_validate(headers, _parsed=_parsed) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/h11/_headers.py", line 164, in normalize_and_validate validate(_field_value_re, value, "Illegal header value {!r}", value) File "/home/vscode/.local/lib/python3.11/site-packages/h11/_util.py", line 91, in validate raise LocalProtocolError(msg) h11._util.LocalProtocolError: Illegal header value b'Bearer '

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 60, in map_httpcore_exceptions yield File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 218, in handle_request resp = self._pool.handle_request(req) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection_pool.py", line 262, in handle_request raise exc File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection_pool.py", line 245, in handle_request response = connection.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection.py", line 96, in handle_request return self._connection.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/http11.py", line 121, in handle_request raise exc File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/http11.py", line 88, in handle_request self._send_request_headers(**kwargs) File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/http11.py", line 129, in _send_request_headers with map_exceptions({h11.LocalProtocolError: LocalProtocolError}): File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions raise to_exc(exc) from exc httpcore.LocalProtocolError: Illegal header value b'Bearer '

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 877, in _request response = self._client.send( ^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 901, in send response = self._send_handling_auth( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 929, in _send_handling_auth response = self._send_handling_redirects( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 966, in _send_handling_redirects response = self._send_single_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 1002, in _send_single_request response = transport.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 217, in handle_request with map_httpcore_exceptions(): File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 77, in map_httpcore_exceptions raise mapped_exc(message) from exc httpx.LocalProtocolError: Illegal header value b'Bearer '

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_exceptions.py", line 10, in map_exceptions yield File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/http11.py", line 130, in _send_request_headers event = h11.Request( ^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/h11/_events.py", line 96, in init self, "headers", normalize_and_validate(headers, _parsed=_parsed) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/h11/_headers.py", line 164, in normalize_and_validate validate(_field_value_re, value, "Illegal header value {!r}", value) File "/home/vscode/.local/lib/python3.11/site-packages/h11/_util.py", line 91, in validate raise LocalProtocolError(msg) h11._util.LocalProtocolError: Illegal header value b'Bearer '

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 60, in map_httpcore_exceptions yield File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 218, in handle_request resp = self._pool.handle_request(req) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection_pool.py", line 262, in handle_request raise exc File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection_pool.py", line 245, in handle_request response = connection.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection.py", line 96, in handle_request return self._connection.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/http11.py", line 121, in handle_request raise exc File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/http11.py", line 88, in handle_request self._send_request_headers(**kwargs) File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/http11.py", line 129, in _send_request_headers with map_exceptions({h11.LocalProtocolError: LocalProtocolError}): File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions raise to_exc(exc) from exc httpcore.LocalProtocolError: Illegal header value b'Bearer '

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 877, in _request response = self._client.send( ^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 901, in send response = self._send_handling_auth( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 929, in _send_handling_auth response = self._send_handling_redirects( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 966, in _send_handling_redirects response = self._send_single_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 1002, in _send_single_request response = transport.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 217, in handle_request with map_httpcore_exceptions(): File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 77, in map_httpcore_exceptions raise mapped_exc(message) from exc httpx.LocalProtocolError: Illegal header value b'Bearer '

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "/workspaces/TaskWeaver/taskweaver/llm/openai.py", line 151, in chat_completion res: Any = self.client.chat.completions.create( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/openai/_utils/_utils.py", line 303, in wrapper return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/openai/resources/chat/completions.py", line 604, in create return self._post( ^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 1088, in post return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 853, in request return self._request( ^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 896, in _request return self._retry_request( ^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 958, in _retry_request return self._request( ^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 896, in _request return self._retry_request( ^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 958, in _retry_request return self._request( ^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 905, in _request raise APIConnectionError(request=request) from err openai.APIConnectionError: Connection error.

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/workspaces/TaskWeaver/taskweaver/session/session.py", line 126, in send_message post = _send_message(post.send_to, post) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/workspaces/TaskWeaver/taskweaver/session/session.py", line 98, in _send_message reply_post = self.planner.reply( ^^^^^^^^^^^^^^^^^^^ File "/workspaces/TaskWeaver/taskweaver/planner/planner.py", line 213, in reply llm_output = self.llm_api.chat_completion(chat_history, use_backup_engine=use_back_up_engine)["content"] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/workspaces/TaskWeaver/taskweaver/llm/init.py", line 85, in chat_completion for msg_chunk in self.completion_service.chat_completion( File "/workspaces/TaskWeaver/taskweaver/llm/openai.py", line 195, in chat_completion raise Exception(f"OpenAI API request failed to connect: {e}") Exception: OpenAI API request failed to connect: Connection error.

Human:

Aborted! vscode ➜ /workspaces/TaskWeaver (main) $ python -m taskweaver -p ./project/


| | | | | | / / __ | |/ _/ __| |/ /| | /| / / _ \/ __/ | / / _ \/ / | | (| __ \ < | |/ |/ / _/ // /| |/ / / / ||_,_|/|_|/|/_/_,/ |/\/_/

TaskWeaver: I am TaskWeaver, an AI assistant. To get started, could you please enter your request? Human: print 1st 5 prime numbers Error: Cannot process your request due to Exception: OpenAI API request failed to connect: Connection error. Traceback (most recent call last): File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_exceptions.py", line 10, in map_exceptions yield File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_backends/sync.py", line 100, in connect_tcp sock = socket.create_connection( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/socket.py", line 851, in create_connection raise exceptions[0] File "/usr/local/lib/python3.11/socket.py", line 836, in create_connection sock.connect(sa) OSError: [Errno 99] Cannot assign requested address

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 60, in map_httpcore_exceptions yield File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 218, in handle_request resp = self._pool.handle_request(req) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection_pool.py", line 262, in handle_request raise exc File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection_pool.py", line 245, in handle_request response = connection.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection.py", line 92, in handle_request raise exc File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection.py", line 69, in handle_request stream = self._connect(request) ^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection.py", line 117, in _connect stream = self._network_backend.connect_tcp(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_backends/sync.py", line 99, in connect_tcp with map_exceptions(exc_map): File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions raise to_exc(exc) from exc httpcore.ConnectError: [Errno 99] Cannot assign requested address

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 877, in _request response = self._client.send( ^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 901, in send response = self._send_handling_auth( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 929, in _send_handling_auth response = self._send_handling_redirects( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 966, in _send_handling_redirects response = self._send_single_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 1002, in _send_single_request response = transport.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 217, in handle_request with map_httpcore_exceptions(): File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 77, in map_httpcore_exceptions raise mapped_exc(message) from exc httpx.ConnectError: [Errno 99] Cannot assign requested address

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_exceptions.py", line 10, in map_exceptions yield File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_backends/sync.py", line 100, in connect_tcp sock = socket.create_connection( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/socket.py", line 851, in create_connection raise exceptions[0] File "/usr/local/lib/python3.11/socket.py", line 836, in create_connection sock.connect(sa) OSError: [Errno 99] Cannot assign requested address

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 60, in map_httpcore_exceptions yield File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 218, in handle_request resp = self._pool.handle_request(req) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection_pool.py", line 262, in handle_request raise exc File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection_pool.py", line 245, in handle_request response = connection.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection.py", line 92, in handle_request raise exc File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection.py", line 69, in handle_request stream = self._connect(request) ^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection.py", line 117, in _connect stream = self._network_backend.connect_tcp(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_backends/sync.py", line 99, in connect_tcp with map_exceptions(exc_map): File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions raise to_exc(exc) from exc httpcore.ConnectError: [Errno 99] Cannot assign requested address

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 877, in _request response = self._client.send( ^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 901, in send response = self._send_handling_auth( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 929, in _send_handling_auth response = self._send_handling_redirects( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 966, in _send_handling_redirects response = self._send_single_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 1002, in _send_single_request response = transport.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 217, in handle_request with map_httpcore_exceptions(): File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 77, in map_httpcore_exceptions raise mapped_exc(message) from exc httpx.ConnectError: [Errno 99] Cannot assign requested address

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_exceptions.py", line 10, in map_exceptions yield File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_backends/sync.py", line 100, in connect_tcp sock = socket.create_connection( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/socket.py", line 851, in create_connection raise exceptions[0] File "/usr/local/lib/python3.11/socket.py", line 836, in create_connection sock.connect(sa) OSError: [Errno 99] Cannot assign requested address

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 60, in map_httpcore_exceptions yield File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 218, in handle_request resp = self._pool.handle_request(req) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection_pool.py", line 262, in handle_request raise exc File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection_pool.py", line 245, in handle_request response = connection.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection.py", line 92, in handle_request raise exc File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection.py", line 69, in handle_request stream = self._connect(request) ^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection.py", line 117, in _connect stream = self._network_backend.connect_tcp(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_backends/sync.py", line 99, in connect_tcp with map_exceptions(exc_map): File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions raise to_exc(exc) from exc httpcore.ConnectError: [Errno 99] Cannot assign requested address

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 877, in _request response = self._client.send( ^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 901, in send response = self._send_handling_auth( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 929, in _send_handling_auth response = self._send_handling_redirects( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 966, in _send_handling_redirects response = self._send_single_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 1002, in _send_single_request response = transport.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 217, in handle_request with map_httpcore_exceptions(): File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 77, in map_httpcore_exceptions raise mapped_exc(message) from exc httpx.ConnectError: [Errno 99] Cannot assign requested address

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "/workspaces/TaskWeaver/taskweaver/llm/openai.py", line 151, in chat_completion res: Any = self.client.chat.completions.create( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/openai/_utils/_utils.py", line 303, in wrapper return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/openai/resources/chat/completions.py", line 604, in create return self._post( ^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 1088, in post return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 853, in request return self._request( ^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 896, in _request return self._retry_request( ^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 958, in _retry_request return self._request( ^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 896, in _request return self._retry_request( ^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 958, in _retry_request return self._request( ^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 905, in _request raise APIConnectionError(request=request) from err openai.APIConnectionError: Connection error.

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/workspaces/TaskWeaver/taskweaver/session/session.py", line 126, in send_message post = _send_message(post.send_to, post) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/workspaces/TaskWeaver/taskweaver/session/session.py", line 98, in _send_message reply_post = self.planner.reply( ^^^^^^^^^^^^^^^^^^^ File "/workspaces/TaskWeaver/taskweaver/planner/planner.py", line 213, in reply llm_output = self.llm_api.chat_completion(chat_history, use_backup_engine=use_back_up_engine)["content"] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/workspaces/TaskWeaver/taskweaver/llm/init.py", line 85, in chat_completion for msg_chunk in self.completion_service.chat_completion( File "/workspaces/TaskWeaver/taskweaver/llm/openai.py", line 195, in chat_completion raise Exception(f"OpenAI API request failed to connect: {e}") Exception: OpenAI API request failed to connect: Connection error.

Human:

Aborted! vscode ➜ /workspaces/TaskWeaver (main) $ python -m taskweaver -p ./project/


| | | | | | / / __ | |/ _/ __| |/ /| | /| / / _ \/ __/ | / / _ \/ / | | (| __ \ < | |/ |/ / _/ // /| |/ / / / ||_,_|/|_|/|/_/_,/ |/\/_/

TaskWeaver: I am TaskWeaver, an AI assistant. To get started, could you please enter your request? Human: print 1st 5 prime numbers Error: Cannot process your request due to Exception: OpenAI API request failed to connect: Connection error. Traceback (most recent call last): File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_exceptions.py", line 10, in map_exceptions yield File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_backends/sync.py", line 100, in connect_tcp sock = socket.create_connection( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/socket.py", line 851, in create_connection raise exceptions[0] File "/usr/local/lib/python3.11/socket.py", line 836, in create_connection sock.connect(sa) OSError: [Errno 99] Cannot assign requested address

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 60, in map_httpcore_exceptions yield File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 218, in handle_request resp = self._pool.handle_request(req) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection_pool.py", line 262, in handle_request raise exc File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection_pool.py", line 245, in handle_request response = connection.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection.py", line 92, in handle_request raise exc File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection.py", line 69, in handle_request stream = self._connect(request) ^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection.py", line 117, in _connect stream = self._network_backend.connect_tcp(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_backends/sync.py", line 99, in connect_tcp with map_exceptions(exc_map): File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions raise to_exc(exc) from exc httpcore.ConnectError: [Errno 99] Cannot assign requested address

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 877, in _request response = self._client.send( ^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 901, in send response = self._send_handling_auth( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 929, in _send_handling_auth response = self._send_handling_redirects( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 966, in _send_handling_redirects response = self._send_single_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 1002, in _send_single_request response = transport.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 217, in handle_request with map_httpcore_exceptions(): File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 77, in map_httpcore_exceptions raise mapped_exc(message) from exc httpx.ConnectError: [Errno 99] Cannot assign requested address

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_exceptions.py", line 10, in map_exceptions yield File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_backends/sync.py", line 100, in connect_tcp sock = socket.create_connection( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/socket.py", line 851, in create_connection raise exceptions[0] File "/usr/local/lib/python3.11/socket.py", line 836, in create_connection sock.connect(sa) OSError: [Errno 99] Cannot assign requested address

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 60, in map_httpcore_exceptions yield File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 218, in handle_request resp = self._pool.handle_request(req) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection_pool.py", line 262, in handle_request raise exc File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection_pool.py", line 245, in handle_request response = connection.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection.py", line 92, in handle_request raise exc File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection.py", line 69, in handle_request stream = self._connect(request) ^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection.py", line 117, in _connect stream = self._network_backend.connect_tcp(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_backends/sync.py", line 99, in connect_tcp with map_exceptions(exc_map): File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions raise to_exc(exc) from exc httpcore.ConnectError: [Errno 99] Cannot assign requested address

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 877, in _request response = self._client.send( ^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 901, in send response = self._send_handling_auth( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 929, in _send_handling_auth response = self._send_handling_redirects( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 966, in _send_handling_redirects response = self._send_single_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 1002, in _send_single_request response = transport.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 217, in handle_request with map_httpcore_exceptions(): File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 77, in map_httpcore_exceptions raise mapped_exc(message) from exc httpx.ConnectError: [Errno 99] Cannot assign requested address

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_exceptions.py", line 10, in map_exceptions yield File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_backends/sync.py", line 100, in connect_tcp sock = socket.create_connection( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/socket.py", line 851, in create_connection raise exceptions[0] File "/usr/local/lib/python3.11/socket.py", line 836, in create_connection sock.connect(sa) OSError: [Errno 99] Cannot assign requested address

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 60, in map_httpcore_exceptions yield File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 218, in handle_request resp = self._pool.handle_request(req) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection_pool.py", line 262, in handle_request raise exc File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection_pool.py", line 245, in handle_request response = connection.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection.py", line 92, in handle_request raise exc File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection.py", line 69, in handle_request stream = self._connect(request) ^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_sync/connection.py", line 117, in _connect stream = self._network_backend.connect_tcp(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_backends/sync.py", line 99, in connect_tcp with map_exceptions(exc_map): File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "/home/vscode/.local/lib/python3.11/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions raise to_exc(exc) from exc httpcore.ConnectError: [Errno 99] Cannot assign requested address

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 877, in _request response = self._client.send( ^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 901, in send response = self._send_handling_auth( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 929, in _send_handling_auth response = self._send_handling_redirects( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 966, in _send_handling_redirects response = self._send_single_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_client.py", line 1002, in _send_single_request response = transport.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 217, in handle_request with map_httpcore_exceptions(): File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit self.gen.throw(typ, value, traceback) File "/home/vscode/.local/lib/python3.11/site-packages/httpx/_transports/default.py", line 77, in map_httpcore_exceptions raise mapped_exc(message) from exc httpx.ConnectError: [Errno 99] Cannot assign requested address

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "/workspaces/TaskWeaver/taskweaver/llm/openai.py", line 151, in chat_completion res: Any = self.client.chat.completions.create( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/openai/_utils/_utils.py", line 303, in wrapper return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/openai/resources/chat/completions.py", line 604, in create return self._post( ^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 1088, in post return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 853, in request return self._request( ^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 896, in _request return self._retry_request( ^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 958, in _retry_request return self._request( ^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 896, in _request return self._retry_request( ^^^^^^^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 958, in _retry_request return self._request( ^^^^^^^^^^^^^^ File "/home/vscode/.local/lib/python3.11/site-packages/openai/_base_client.py", line 905, in _request raise APIConnectionError(request=request) from err openai.APIConnectionError: Connection error.

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/workspaces/TaskWeaver/taskweaver/session/session.py", line 126, in send_message post = _send_message(post.send_to, post) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/workspaces/TaskWeaver/taskweaver/session/session.py", line 98, in _send_message reply_post = self.planner.reply( ^^^^^^^^^^^^^^^^^^^ File "/workspaces/TaskWeaver/taskweaver/planner/planner.py", line 213, in reply llm_output = self.llm_api.chat_completion(chat_history, use_backup_engine=use_back_up_engine)["content"] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/workspaces/TaskWeaver/taskweaver/llm/init.py", line 85, in chat_completion for msg_chunk in self.completion_service.chat_completion( File "/workspaces/TaskWeaver/taskweaver/llm/openai.py", line 195, in chat_completion raise Exception(f"OpenAI API request failed to connect: {e}") Exception: OpenAI API request failed to connect: Connection error.

  1. See error

Expected behavior it supposed to connect and work

Screenshots If applicable, add screenshots to help explain your problem.

Environment Information (please complete the following information):

Additional context Add any other context about the problem here. I am running inside docker dev container

glufy100 commented 10 months ago

here use this config:

{ "llm.api_base": "http://localhost:1234/v1", "llm.api_key": "null", "llm.model": "mistral", "llm.response": "text" }

wwExpert commented 9 months ago

Hi, have you tried using a different setting as a preset? Also you have to check to use the right Port number.

image

teachable-david commented 9 months ago

Any updates on this? I get the same error text as OP. I was able to use TaskWeaver recently for a period of a couple weeks until the most recent update, when I started getting the "Illegal header value b'Bearer'" error again, which seems to indicate an issue with the config file. I've tried formatting the config file many ways, including using the format in the penultimate response on this thread. I have Python 3.11. I tried pip install -r requirements.txt --upgrade within the TaskWeaver folder. My LM studio client is up-to-date. I have tried multiple settings presets and multiple LLMs in LM Studio, including the model that worked for a couple weeks. When I say it worked, I mean that TaskWeaver responded without error text. Now, when I use TaskWeaver UI, the command prompt seems to indicate that TaskWeaver starts, but then it has an error connecting to OpenAI:

If UI is not started, please go to the folder playground/UI and run chainlit run app.py to start the UI 2024-01-23 09:08:14 - Your app is available at http://localhost:8000 2024-01-23 09:08:16 - Planner initialized successfully 2024-01-23 09:08:16 - CodeInterpreter initialized successfully. 2024-01-23 09:08:16 - Session 20240123-150816-65a8923c is initialized 2024-01-23 09:08:34 - Task exception was never retrieved

after that displays the same traceback text that OP posted. I started learning Python a few months ago, so I accept the likelihood that it's a n00b mistake on my part, but I am currently stumped as to what. I'd really like to use this open-source framework with an open-source LLM, rather than throwing money at Chat-GPT.

glufy10 commented 9 months ago

the probleme is that i have a slow pc so generating ai tack a lot of time. so often what happend is that taskweawer is stoping becausse of a timeout

teachable-david commented 9 months ago

the probleme is that i have a slow pc so generating ai tack a lot of time. so often what happend is that taskweawer is stoping becausse of a timeout

I'm not sure that's causing the "Illegal header value b'Bearer' token" timeout. But if you try lighter requests or a smaller LLM your computer should be able to handle it.

teachable-david commented 9 months ago

Bing/Copilot indicates that the error seems to be an issue with the config file. However, VS shows no errors in the config file. I have tried variations of the following configs:

{ "llm.api_base": "http://localhost:1234/v1", "llm.api_key": null, "llm.model": "model", "llm.response_format": "text" }

and

{ "api_base": "http://localhost:1234/v1", "api_key": null, "model": "llama-2-7b-chat.Q8_0.gguf", "response_format": "text" }

I've tried "None" "none" "null" for the key. I've tried adding /chat/completions to api_base. I've tried with and without a VPN. I've tried different models, including one that worked at one point. I have tried with and without response_format. I have used the default settings in LM Studio and ensured that the client is updated. I have upgraded requirements.txt. I don't have Internet connection issues that could cause this error.

Any suggestions?

teachable-david commented 9 months ago

It started working after I formatted my config file like a post in this thread and I think what made the difference is the "llm.api_key" format. The TaskWeaver Blog indicates that the string null without markdown or capitalization is an acceptable argument for the "llm.api_key" parameter. However, when I used "0" like the post in the linked thread, it worked. It seems TaskWeaver requires a value in quotes for the "llm.api_key" parameter.