search

bentoml / OpenLLM

Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.
https://bentoml.com
Apache License 2.0
9.73k stars 620 forks source link

feature: Add JAIS Models #923

Closed aliozts closed 3 months ago

aliozts commented 6 months ago

This is my attempt to add jais model into OpenLLM ecosystem. They are using a custom architecture which is specified in the architecture parameter in config. I'd appreciate any help or feedback.

aliozts commented 6 months ago

Hi @aarnphm is there anything I can do to help on this?