How to deploy WizardCoder-Python-34B as a Sagemaker Endpoint?

nlpxucan / WizardLM

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath

9.11k stars 711 forks source link

Open jackkwok opened 11 months ago

jackkwok commented 11 months ago

Can someone share some sample code on deploying WizardCoder-Python-34B as a Sagemaker Endpoint?