search

zhuohaoyu / KIEval

[ACL'24] A Knowledge-grounded Interactive Evaluation Framework for Large Language Models
25 stars 3 forks source link

raise OSError(err, f'Connect call failed {address}') ConnectionRefusedError: [Errno 111] Connect call failed ('10.244.48.126', 8080) #2

Open ALLISWELL8 opened 1 week ago

zhuohaoyu commented 1 week ago

Hi, from the error message you posted, I think you might need to take a quick look at the official quickstart guide of text-generation-inference (https://huggingface.co/docs/text-generation-inference/quicktour). This might help you resolve issues related to deploying models for evaluation.

ALLISWELL8 commented 1 week ago

你好，打扰一下，我之前没有接触过这种方式部署模型，你能提供一个详细的解决该问题的方式吗