Unable to deploy space with chatUI, getting error ** Failed to connect to 127.0.0.1 port 8080 after 0 ms**

starlord263 commented 1 month ago

Hi guys, so i am trying to deploy space with chatui template and abacusai/Smaug-Llama-3-70B-Instruct model but i am getting following error again and again in container logs.

curl: (7) Failed to connect to 127.0.0.1 port 8080 after 0 ms: Connection refused Warning: Problem : connection refused. Will retry in 10 seconds. 40 retries Warning: left. 2024-05-26T07:02:16.945294Z INFO text_generation_launcher: Downloaded /data/models--abacusai--Smaug-Llama-3-70B-Instruct/snapshots/fbaa713bdcdc2a2f85bbbe5808ec7046700a36e5/model-00007-of-00030.safetensors in 0:00:29. 2024-05-26T07:02:16.945393Z INFO text_generation_launcher: Download: [7/30] -- ETA: 0:10:47.285711 2024-05-26T07:02:16.945714Z INFO text_generation_launcher: Download file: model-00008-of-00030.safetensors 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 curl: (7) Failed to connect to 127.0.0.1 port 8080 after 0 ms: Connection refused Warning: Problem : connection refused. Will retry in 10 seconds. 39 retries Warning: left. 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 curl: (7) Failed to connect to 127.0.0.1 port 8080 after 0 ms: Connection refused Warning: Problem : connection refused. Will retry in 10 seconds. 38 retries Warning: left. 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 curl: (7) Failed to connect to 127.0.0.1 port 8080 after 0 ms: Connection refused Warning: Problem : connection refused. Will retry in 10 seconds. 37 retries Warning: left. 2024-05-26T07:02:47.664282Z INFO text_generation_launcher: Downloaded /data/models--abacusai--Smaug-Llama-3-70B-Instruct/snapshots/fbaa713bdcdc2a2f85bbbe5808ec7046700a36e5/model-00008-of-00030.safetensors in 0:00:30. 2024-05-26T07:02:47.664376Z INFO text_generation_launcher: Download: [8/30] -- ETA: 0:10:27 2024-05-26T07:02:47.664710Z INFO text_generation_launcher: Download file: model-00009-of-00030.safetensors 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 curl: (7) Failed to connect to 127.0.0.1 port 8080 after 0 ms: Connection refused Warning: Problem : connection refused. Will retry in 10 seconds. 36 retries Warning: left. {"t":{"$date":"2024-05-26T09:02:57.879+02:00"},"s":"I", "c":"WTCHKPT", "id":22430, "ctx":"Checkpointer","msg":"WiredTiger message","attr":{"message":{"ts_sec":1716706977,"ts_usec":879791,"thread":"8:0x7f4c6fd8f640","session_name":"WT_SESSION.checkpoint","category":"WT_VERB_CHECKPOINT_PROGRESS","category_id":6,"verbose_level":"DEBUG_1","verbose_level_id":1,"msg":"saving checkpoint snapshot min: 37, snapshot max: 37 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0) base write gen: 1"}}} 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 curl: (7) Failed to connect to 127.0.0.1 port 8080 after 0 ms: Connection refused Warning: Problem : connection refused. Will retry in 10 seconds. 35 retries Warning: left.

please help me out thanks

and yes i've added HF_TOEKN secret too

starlord263 commented 1 month ago

@nsarrazin can you please help

nsarrazin commented 1 month ago

Will take a look! Something might be broken with the template.

rodrigobdz commented 1 month ago

Facing the same issue with the default template.

Reproduction steps

Click on https://huggingface.co/new-space?template=huggingchat/chat-ui-template
Set secret HF_TOKEN
Click on Create space

Possible Causes

At first I wasn't sure if the error was related to https://github.com/huggingface/chat-ui/issues/1185, but it seems it isn't.
Leaving MONGODB_URL empty, as mentioned in the docs, leads to the following message. I can create a separate issue but this warning seems related to the deployment issues when deploying the Chat UI with the current template.

Please specify the MONGODB_URL environment variable inside .env.local. Set it to mongodb://localhost:27017 if you are running MongoDB locally, or to a MongoDB Atlas free instance for example.

huggingface / chat-ui