replit / ReplitLM

Inference code and configs for the ReplitLM model family
https://huggingface.co/replit
Apache License 2.0
918 stars 75 forks source link

How to start the server mode? #22

Closed luckyfish0826 closed 1 year ago

luckyfish0826 commented 1 year ago

Thank you for your work. Any chance you can give some demo on how to start the server mode?

Due to information risk policy, we could not use the server mode as the way your provide in "inference Endpoints".

luckyfish0826 commented 1 year ago

found similar thread https://huggingface.co/replit/replit-code-v1-3b/discussions/7