search

darrenburns / elia

A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.
Apache License 2.0
1.58k stars 106 forks source link

Can't run local model. #65

Open Ji-Shao opened 4 weeks ago

Ji-Shao commented 4 weeks ago

according the README. to run local model, "The location of the configuration file is noted at the bottom of the options window (ctrl+o)."

"ctrl+o" didn't work on Linux. How can I place the config file?

another issue: If you don't export OPENAI_API_KEY, it won't start. even if you would like to use local model.

$ elia Traceback (most recent call last): File "/home/terx/.local/bin/elia", line 5, in from elia_chat.main import cli File "/home/terx/.local/share/pipx/venvs/elia-chat/lib/python3.10/site-packages/elia_chat/main.py", line 10, in from elia_chat.app import Elia File "/home/terx/.local/share/pipx/venvs/elia-chat/lib/python3.10/site-packages/elia_chat/app.py", line 8, in from elia_chat.models import EliaContext File "/home/terx/.local/share/pipx/venvs/elia-chat/lib/python3.10/site-packages/elia_chat/models.py", line 9, in from elia_chat.widgets.chat_options import GPTModel, MODEL_MAPPING, DEFAULT_MODEL File "/home/terx/.local/share/pipx/venvs/elia-chat/lib/python3.10/site-packages/elia_chat/widgets/chat_options.py", line 44, in model=ChatOpenAI( File "/home/terx/.local/share/pipx/venvs/elia-chat/lib/python3.10/site-packages/langchain/load/serializable.py", line 97, in init super().init(**kwargs) File "pydantic/main.py", line 341, in pydantic.main.BaseModel.init pydantic.error_wrappers.ValidationError: 1 validation error for ChatOpenAI root Did not find openai_api_key, please add an environment variable OPENAI_API_KEY which contains it, or pass openai_api_key as a named parameter. (type=value_error)

darrenburns commented 4 weeks ago

You're using an old version of Elia - hopefully this helps: https://github.com/darrenburns/elia/issues/56#issuecomment-2132438352