s-kostyaev / ellama

Ellama is a tool for interacting with large language models from Emacs.
GNU General Public License v3.0
378 stars 27 forks source link

feat: Introduce interactive LLM switching #16

Closed LionyxML closed 7 months ago

LionyxML commented 8 months ago

This commit adds the ellama-select-local-ollama-model function, allowing users to interactively switch between locally available Ollama models.

You can call this function: image

It will prompt you to select a model: image

You select your model: image

You interact with the model: image

You then call the function again, select another model, like: image

And then, you can use this one: image

This provides a "quick switch" between models. I've been using it to change codellama models when the less powerfull ones starts giving nonsense answers, quicky and some sort of dirty. ;)

s-kostyaev commented 8 months ago

Cool, thank you for contributing.

LionyxML commented 8 months ago

@s-kostyaev, new commit addresses the points raised in the code review.

max-arnold commented 7 months ago

What do you think about making this feature more generic to allow switching providers (from a preconfigured list)?

stephenwithav commented 7 months ago

LGTM. I need this. Thanks, @LionyxML!

s-kostyaev commented 7 months ago

What do you think about making this feature more generic to allow switching providers (from a preconfigured list)?

Good idea. I already thought about that. But it can be separate feature, because with ollama we can get list interactively. But we can't do it with other providers.

LionyxML commented 7 months ago

Hey there @s-kostyaev! I just received confirmation of the FSF process completion. Do I have to send you something?

s-kostyaev commented 7 months ago

Hey there @s-kostyaev! I just received confirmation of the FSF process completion. Do I have to send you something?

This message is enough, thank you. At the weekend I will review your PRs one more time. I also have confirmation from FSF and I need to make some changes for project transition.

s-kostyaev commented 7 months ago

This PR we will merge after your first PR. You need to rebase it and add command into keymap.

tusharhero commented 7 months ago

Yay!

LionyxML commented 7 months ago

@s-kostyaev rebased and pushed. Let's hope for the best with CI :smile:

s-kostyaev commented 7 months ago

I've got an idea from this PR and provide different implementation. See new command ellama-provider-select.