search

hpcaitech / EnergonAI

Large-scale model inference.
Apache License 2.0
630 stars 90 forks source link

can't find server.sh #160

Open zhangyilalala opened 1 year ago

zhangyilalala commented 1 year ago

I can't find server.sh,how can I run a example now？

kukrishna commented 1 year ago

I was running OPT and I got the same error. https://www.colossalai.org/docs/advanced_tutorials/opt_service/ mentions server.sh but where is the server.sh file?

wkkautas commented 1 year ago

It seems there are a lot of changes after v0.0.1. I found server.sh here. https://github.com/hpcaitech/EnergonAI/tree/v0.0.1/examples/opt

ychy00001 commented 1 year ago

It seems there are a lot of changes after v0.0.1. I found server.sh here. https://github.com/hpcaitech/EnergonAI/tree/v0.0.1/examples/opt

try to use this cmd to run. More thing find in EnergonAI/examples/opt/README.md

python opt_fastapi.py opt-125m --checkpoint xxx

I think server.sh is old version to used. now replace use python cmd directly