Support for GPT3 based models

runpod-workers / worker-vllm

The RunPod worker template for serving our large language model endpoints. Powered by vLLM.

MIT License

213 stars 82 forks source link

Closed letajmal closed 6 months ago

letajmal commented 6 months ago

Requesting for GPT3 based model support in worker

alpayariyak commented 6 months ago

Hi, GPT-3 is not open source.

The following GPT architectures are supported:

GPT-2 (gpt2, gpt2-xl, etc.)
GPT BigCode (bigcode/starcoder, bigcode/gpt_bigcode-santacoder, etc.)
GPT-J (EleutherAI/gpt-j-6b, nomic-ai/gpt4all-j, etc.)
GPT-NeoX (EleutherAI/gpt-neox-20b, databricks/dolly-v2-12b, stabilityai/stablelm-tuned-alpha-7b, etc.)