bentoml / llm-bench

28 stars 3 forks source link

Base_URL based problem #11

Open Amber-Believe opened 1 month ago

Amber-Believe commented 1 month ago

image When ping_url = HTTP: / loacalhost: 3000 / healthz, return a 404 error, unable to connect; If ping_url=http:/loacalhost:3000/, Status: defaultdict(<class 'int'>, {4040:3635}), image

How should I modify ping_url to complete the correct test with chat

Amber-Believe commented 1 month ago

解决了