Open Vinkle-hzt opened 1 year ago
Support local models by using argument --local, like:
--local
python3 -m flexgen.flex_opt --model /home/username/model/facebook/opt-1.3b --local
It will load the locally downloaded opt-1.3b model instead of the opt-1.3b from huggingface.
Support local models by using argument
--local, like:It will load the locally downloaded opt-1.3b model instead of the opt-1.3b from huggingface.