Feature: LocalAI (openAI API compatible self-hosted models)

StatCan / aaw-kubeflow-containers

Containers built to be used with Kubeflow for Data Science

Other

24 stars 21 forks source link

Feature: LocalAI (openAI API compatible self-hosted models) #568

Closed bryanpaget closed 3 months ago

bryanpaget commented 8 months ago

LocalAI is the free, Open Source OpenAI alternative. LocalAI act as a drop-in replacement REST API that’s compatible with OpenAI API specifications for local inferencing. It allows you to run LLMs, generate images, audio (and not only) locally or on-prem with consumer grade hardware, supporting multiple model families that are compatible with the ggml format. Does not require GPU. It is maintained by mudler.

https://localai.io/

Souheil-Yazji commented 3 months ago

I would put this under AI tools for the zone as well.