search

LucienShui / huggingface-vscode-endpoint-server

starcoder server for huggingface-vscdoe custom endpoint
Apache License 2.0
166 stars 55 forks source link

any chance to config the model local foler? #7

Closed luckyfish0826 closed 1 year ago

luckyfish0826 commented 1 year ago

so we could save the model download time and use our own custom model bin file. Thanks

fr3deric commented 1 year ago

You can download the model seperatly to any destination you like and then point the endpoint-server to the directory, i.e. python main.py --pretrained="../my_model"

luckyfish0826 commented 1 year ago

You can download the model seperatly to any destination you like and then point the endpoint-server to the directory, i.e. python main.py --pretrained="../my_model"

Thanks, yet seems it's not working, I'll try more ways and let you know the result.

LucienShui commented 1 year ago

It seems you've done what you want, if there's still any problem, you can reopen it.

iamjameswalters commented 4 months ago

You can download the model seperatly to any destination you like and then point the endpoint-server to the directory, i.e. python main.py --pretrained="../my_model"

Could you explain this? I have no idea what "download the model" means. Where are we getting it?