eosphoros-ai / DB-GPT

AI Native Data App Development framework with AWEL(Agentic Workflow Expression Language) and Agents
https://docs.dbgpt.site
MIT License
12.37k stars 1.61k forks source link

[Bug] [llama3] error on sync to elastic #1667

Open neulf opened 1 week ago

neulf commented 1 week ago

Search before asking

Operating system information

Linux

Python version information

=3.11

DB-GPT version

main

Related scenes

Installation Information

Device information

CPU

Models information

LLM_MODEL=ollama_proxyllm PROXY_SERVER_URL=http://192.168.68.71:30434/ PROXYLLM_BACKEND="llama3" PROXY_API_KEY=not_used

EMBEDDING_MODEL=proxy_ollama proxy_ollama_proxy_server_url=http://127.0.0.1:11434/ proxy_ollama_proxy_backend="nomic-embed-text:latest"

VECTOR_STORE_TYPE=ElasticSearch ElasticSearch_URL=127.0.0.1 ElasticSearch_PORT=9200 ElasticSearch_USERNAME=elastic ElasticSearch_PASSWORD=i=+iLw9y0Jduq86XTi6W

What happened

2024-06-25 17:32:11 dbgpt elastic_transport.transport[3620] WARNING Retrying request after failure (attempt 2 of 3) Traceback (most recent call last): File "/home/yhp/anaconda3/envs/dbgpt_env/lib/python3.10/site-packages/elastic_transport/_transport.py", line 342, in perform_request resp = node.perform_request( File "/home/yhp/anaconda3/envs/dbgpt_env/lib/python3.10/site-packages/elastic_transport/_node/_http_urllib3.py", line 202, in perform_request raise err from None elastic_transport.ConnectionError: Connection error caused by: NewConnectionError(<urllib3.connection.HTTPConnection object at 0x7f74d8fcf460>: Failed to establish a new connection: [Errno 111] Connection refused) 2024-06-25 17:32:11 dbgpt elastic_transport.transport[3620] INFO HEAD http://localhost:9200/yhp [status:N/A duration:0.001s] 2024-06-25 17:32:11 dbgpt elastic_transport.node_pool[3620] WARNING Node <Urllib3HttpNode(http://localhost:9200)> has failed for 4 times in a row, putting on 8 second timeout 2024-06-25 17:32:11 dbgpt dbgpt.serve.rag.connector[3620] ERROR connect vector store failed: Connection error caused by: ConnectionError(Connection error caused by: NewConnectionError(<urllib3.connection.HTTPConnection object at 0x7f74d8fecee0>: Failed to establish a new connection: [Errno 111] Connection refused))

What you expected to happen

no errors.

How to reproduce

image

Additional context

Test elastic

image

Are you willing to submit PR?

Aries-ckt commented 1 week ago

hi @neulf , i guess space storage type you choose FullText type, set in .env

ELASTICSEARCH_URL=localhost
ELASTICSEARCH_PORT=9200
ELASTICSEARCH_USERNAME=elastic
ELASTICSEARCH_PASSWORD=dbgpt
Carlycjl commented 1 week ago

I got the same problem. document sync batch error Connection error caused by: ConnectionError(Connection error caused by: ProtocolError(('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))))

Aries-ckt commented 6 days ago

@Carlycjl ,how did you set your elastic config?

Carlycjl commented 4 days ago

@Carlycjl ,how did you set your elastic config? Just follow the document as following.

ELASTICSEARCH_URL=localhost ELASTICSEARCH_PORT=9200 ELASTICSEARCH_USERNAME=elastic ELASTICSEARCH_PASSWORD=dbgpt