Hello! Thank you for this awesome work. I am testing Punica for serving my custom models and it has GPT-NEOX model as the base model. Currently, does Punica support other models than Llama?
If it doesn't require much modification, I would like to request to give us some manual to add new models.
Thank you! :)
Hello! Thank you for this awesome work. I am testing
Punicafor serving my custom models and it has GPT-NEOX model as the base model. Currently, doesPunicasupport other models than Llama? If it doesn't require much modification, I would like to request to give us some manual to add new models. Thank you! :)