huggingface / transformers-bloom-inference

Fast Inference Solutions for BLOOM
Apache License 2.0
560 stars 114 forks source link

The Makefile execution was successful, but there is no response when entering text. #96

Open dizhenx opened 1 year ago

dizhenx commented 1 year ago

When running the command "make bloom-560m" on CentOS, it executed successfully. However, when you entered text in the browser and clicked the submit button, it kept displaying the message "Processing" without returning an answer. Upon checking the backend, you found the following error:

INFO: Started server process [5229] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:5001 (Press CTRL+C to quit) model loaded INFO: 192.168.2.54:61604 - "GET / HTTP/1.1" 200 OK INFO: 192.168.2.54:61604 - "GET /css/style.css HTTP/1.1" 200 OK INFO: 192.168.2.54:61606 - "GET /js/index.js HTTP/1.1" 200 OK INFO: 192.168.2.54:61604 - "GET /favicon.ico HTTP/1.1" 404 Not Found

This error indicates that port 5001 is accessible, but port 5000 in the backend is returning a 404 error. What is the reason?