本地部署疑问

[XduSyL]

Initial Checks

• [ ] I have searched GitHub for a duplicate issue and I'm sure this is something new
• [ ] I have read and followed the docs & demos and still think this is a bug
• [ ] I am confident that the issue is with modelscope-agent (not my code, or another library in the ecosystem)

What happened + What you expected to happen

请问一下，本地部署之后，怎么通过demo/demo_qwen_agent.ipynb 这个例子来使用呢，就是部署完成之后怎么通过实例化RolePlay，来调用本地部署完成的qwen-7b呢，我在这个目录（config/cfg_model_template.json）下 添加了 "qwen1.5-7b-chat": { "type": "openai", "model": "qwen/Qwen1.5-7B-Chat", "api_base": "http://localhost:8000/v1", "is_chat": true, "is_function_call": false } 之后，关掉api_key,然后再llm_config中修改为'qwen1.5-7b-chat' ,此时无法调用本地llm来运行

Versions / Dependencies

无

Reproduction script

无

Issue Severity

None

[zzhangpurdue]

参考这个例子：https://github.com/modelscope/modelscope-agent/blob/master/examples/llms/local_llm.ipynb

[gudeyang1]

参考这个例子：https://github.com/modelscope/modelscope-agent/blob/master/demo/demo_qwen_local_llm.ipynb

hi, 无法在代码仓库中找到这个demo文件

[zzhangpurdue]

https://github.com/modelscope/modelscope-agent/blob/master/examples/llms/local_llm.ipynb 你好，由于本周做了example结构调整，还没来得及更新。

[etersin]

本地使用modelscope-swift运行模型，这里使用本地方式方式调用接口，执行报错 调整了几种方式，都无法解决，求指教