Need help in Deploying this model locally.

dylanjcastillo / shell-genie

Your wishes are my commands

MIT License

478 stars 36 forks source link

Need help in Deploying this model locally. #20

Open dhawal1304 opened 6 months ago

dhawal1304 commented 6 months ago

Hey @dylanjcastillo

Kudos on your amazing creation! It's working wonders on our machine. We've got some unique tasks to handle via the CLI, so we're keen on deploying and training this gem locally. Any chance you could drop some quick steps our way? If any bumps come up, expect a ping from me.

dylanjcastillo commented 6 months ago

Hey @dhawal1304,

For local deployment I'd suggest checking deepseek, and maybe something like vllm. Most likely I'm going to archive this repository soon.

Best, Dylan