Using 3rd-party OpenAI-compatible providers

darrenburns / elia

A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.

Apache License 2.0

1.78k stars 115 forks source link

Using 3rd-party OpenAI-compatible providers #33

Closed johnd0e closed 4 months ago

johnd0e commented 4 months ago

At the moment it is possible setting OPENAI_API_KEY / OPENAI_API_BASE variables.

But such setup does not allow to switch providers on-the-fly, or use some specific models.

Perhaps it could be implemented with some settings in config.toml.

My initial ideas:

Each OPENAI_API_BASE value should be separate provider, with own name.
The corresponding value of OPENAI_API_KEY should be stored in config.toml too.