OpenBMB / ToolBench

[ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.

https://openbmb.github.io/ToolBench/

Apache License 2.0

4.74k stars 400 forks source link

启动server #141

Open Orlando1021 opened 1 year ago

Orlando1021 commented 1 year ago

启动server

python toolbench/inference/toolbench_server.py \ --tool_root_dir data/toolenv/tools/ \ --corpus_tsv_path data/retrieval/G1/corpus.tsv \ --retrieval_model_path /share/ToolBench/ToolBench_IR_bert_based_uncased \ --retrieved_api_nums 5 \ --backbone_model toolllama \ --model_path /share/models/ToolLLaMA-2-7b \ --max_observation_length 1024 \ --method DFS_woFilter_w2 \ --input_query_file data/instruction/inference_query_demo_open_domain.json \ --output_answer_file data/answer/toolllama_lora_dfs_open_domain \ --rapidapi_key $rapidapi_key

启动ui的时候 rapidapi_key要去哪里获取呢？ rapidhub上不同的api有不同的key

pooruss commented 1 year ago

您好，rapidapi_key可以从这里获取：

登陆rapidapi -> 右上角头像 -> Personal Billing -> 左栏My Apps -> default-application_*** -> Authorization -> Application Key

Orlando1021 commented 1 year ago

@pooruss 需要subscribe目录data/toolenv/tools/的每个api才能用跑通这个命令吗？感觉不是很友好

pooruss commented 1 year ago

我们提供RapidAPI后端服务，让大家无需使用自己的RapidAPI key和订阅每个API，通过填写我们的form进行申请，我们将尽快进行审核并发送toolbench_key让您使用我们的后端服务

Orlando1021 commented 1 year ago

@pooruss 我有toolbench_key了，尝试用toolbench_key 替换rapidapi_keypython toolbench/inference/toolbench_server.py --tool_root_dir data/toolenv/tools/ --corpus_tsv_path data/retrieval/G1/corpus.tsv --retrieval_model_path /share/ToolBench/ToolBench_IR_bert_based_uncased --retrieved_api_nums 5 --backbone_model toolllama --model_path /share/models/ToolLLaMA-2-7b --max_observation_length 1024 --method DFS_woFilter_w2 --input_query_file data/instruction/inference_query_demo_open_domain.json --output_answer_file data/answer/toolllama_lora_dfs_open_domain --toolbench_key $toolbench_key 。这样也不work

pooruss commented 11 months ago

请问可以提供下具体的报错信息吗