search

mudler / LocalAI

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed inference
https://localai.io
MIT License
23.63k stars 1.81k forks source link

feat(ui): allow to select between all the available models in the chat #2657

Closed mudler closed 3 months ago

mudler commented 3 months ago

TLDR

This PR is part of #2156 . It is a small change to allow to chat with any model present in the model folder (not only these with a YAML file).

Description

As now we have capabilities to identify automatically gguf files ( https://github.com/mudler/LocalAI/pull/2536 ), we can now show in the select box in the chat all the models - even these which are single files in the models folder without an associated YAML file.

The system will automatically identify the gguf model and apply a default template if required, as such there is no need to create a YAML file anymore to let the model pop-up in the chat selection.

netlify[bot] commented 3 months ago

Deploy Preview for localai ready!

Name Link
Latest commit 7746ed168d26e33287df9a97334c357061156561
Latest deploy log https://app.netlify.com/sites/localai/deploys/667b03336d2066000872fa8a
Deploy Preview https://deploy-preview-2657--localai.netlify.app
Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.