search

tangqiaoyu / ToolAlpaca

the official code for "ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Cases"
Apache License 2.0
851 stars 38 forks source link

error in evaluation -- connection #16

Closed shadii4 closed 3 months ago

shadii4 commented 8 months ago

when i run evaluation

get LLM outputs

python instance_generation/generation.py \ -api ./data/eval_simulated.json \ -out ./eval \ -llm ./outputs/model1 \ --agent_prompt test_v1 \

I get an error: ConnectionError: HTTPConnectionPool(host='127.0.0.1', port=5678): Max retries exceeded with url: /Axolotl/random (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f635fb4c5b0>: Failed to establish a new connection: [Errno 111] Connection refused'))

Can you help me with this please, thanks!

tangqiaoyu commented 8 months ago

Hi, you should start the API simulator first.

python instance_generation/simulator.py -api ./data/eval_simulated.json