search

huggingface / text-embeddings-inference

A blazing fast inference solution for text embeddings models
https://huggingface.co/docs/text-embeddings-inference/quick_tour
Apache License 2.0
2.58k stars 161 forks source link

curl: (56) Recv failure: Connection reset by peer #387

Open luyu0816 opened 3 weeks ago

luyu0816 commented 3 weeks ago

System Info

ubuntu2024 RTX3070

Information

Tasks

Reproduction

屏幕截图 2024-08-21 094056

Expected behavior

docker command: docker run --gpus all -p 8080:80 -v $PWD/data:/data --pull always ghcr.io/huggingface/text-embeddings-inference:1.5 --model-id BAAI/bge-reranker-large

kozistr commented 3 weeks ago

@luyu0816 based on the image you shared, it looks like TEI is still downloading the model & configuration files. could you please try again after the server has fully started up?

you can check the below message in the stdout when the server is ready.

...
2024-08-03T12:27:26.237104Z  INFO text_embeddings_router::http::server: router/src/http/server.rs:1778: Starting HTTP server: 0.0.0.0:12345
2024-08-03T12:27:26.237197Z  INFO text_embeddings_router::http::server: router/src/http/server.rs:1779: Ready