OpenBMB / ToolBench

[ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.
https://openbmb.github.io/ToolBench/
Apache License 2.0
4.74k stars 401 forks source link

Server挂了 #293

Open farawayxxx opened 1 month ago

farawayxxx commented 1 month ago

MaxRetryError: HTTPConnectionPool(host='8.218.239.54', port=8080): Max retries exceeded with url: /rapidapi (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7fd9977ed990>, 'Connection to 8.218.239.54 timed out. (connect timeout=15)'))

wwfnb commented 1 month ago

+1 HTTPConnectionPool(host='8.218.239.54', port=8080): Max retries exceeded with url: /rapidapi (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f7cdad71720>, 'Connection to 8.218.239.54 timed out. (connect timeout=None)'))

kingb12 commented 1 month ago

Also seeing issues connecting to this server

Mrlyk423 commented 1 month ago

We are working to fix the server now. Please wait for some time.

itshuey commented 1 month ago

Is it possible to receive a rapidapi key during this time? I am planning on hosting the server locally.

skzhang1 commented 1 month ago

Is it possible to receive a rapidapi key during this time? I am planning on hosting the server locally.

The same question here.. The provided rapid API seems have some problems. Can you provide an instructions to illustrate the way of getting a Rapidapi key that could access to the API available in this benchmark? Thanks

zkx06111 commented 1 month ago

Any guide for building our own server/obtaining an API key that works would be helpful.

itshuey commented 1 month ago

@zkx06111 I was able to build a local copy from the link in their repository. However, it requires you to sign up for rapidapi and manually subscribe to each API. For example, for the cocktail API, you need to subscribe here to get an api key, put the key into the rapidapi_keys.txt, and then start the server. You can then use the following query to test that it is running correctly:

curl -X POST "http://0.0.0.0:8080/rapidapi" -H "Content-Type: application/json" -d '{ "category": "Food", "tool_name": "Cocktail", "api_name": "Receive the cocktail data", "tool_input": "{\"cocktail_name\": \"blood\"}", "strip": "filter", "toolbench_key": "setyourownuserkeyheresoyoucandistributetootherpeople" }

By hosting the ToolBench server, OpenBMB essentially handles the subscriptions for us, which saves a lot of work. Hope the server can be fixed soon and thanks for the hard work!

skzhang1 commented 1 month ago

Anyone can provide a Rapidapi key subscribing all tools in the benchmark? Really appreciate it!

quocthai9120 commented 1 month ago

Hi @Mrlyk423 , thanks for spending efforts to fix the server! Do you have some eta of when the server will be available again? We want to do some benchmark using the evaluation sets from ToolBench, so it would be very nice to have the server alive. Thank you!