The new version of Starcoder is out (about 4 months ago).
Can you include it to the supported models.
This comes when I try to start the server with this model:
RuntimeError: Failed to determine config class for bigcode/starcoder2-15b. Got ['Starcoder2ForCausalLM'], which is not yet supported (Supported: ['BaichuanForCausalLM', 'ChatGLMModel', 'CohereForCausalLM', 'DbrxForCausalLM', 'GPTNeoXForCausalLM', 'FalconForCausalLM', 'GemmaForCausalLM', 'LlamaForCausalLM', 'MistralForCausalLM', 'MixtralForCausalLM', 'MPTForCausalLM', 'OPTForCausalLM', 'Phi3ForCausalLM', 'QWenLMHeadModel', 'GPTBigCodeForCausalLM', 'YiForCausalLM'])
Feature request
The new version of Starcoder is out (about 4 months ago). Can you include it to the supported models. This comes when I try to start the server with this model:
This is surprising, since vllm should have no problems loading the new model: https://docs.vllm.ai/en/latest/models/supported_models.html
Motivation
No response
Other
No response