Update Xinference and add some open source LLMs

biocypher / biochatter

Backend library for conversational AI in biomedicine

http://biochatter.org/

MIT License

51 stars 19 forks source link

Update Xinference and add some open source LLMs #142

Closed slobentanzer closed 2 months ago

slobentanzer commented 2 months ago

Update Xinference to 0.10.3 and add Google Gemma models and LLaMA 3 Chat. Models not all functional on Mac, Linux tests pending. Ran benchmark on the models that worked.