search

BuilderIO / ai-shell

A CLI that converts natural language to shell commands.
MIT License
4.21k stars 278 forks source link

Configuring groq api support #126

Open KhalfaniW opened 3 months ago

KhalfaniW commented 3 months ago

You can set the config like this to use groq instead of openai

OPENAI_API_ENDPOINT=https://api.groq.com/openai/v1
OPENAI_KEY=<groq api key>
MODEL=<llama model>

This creates commands correctly, but i get this error when it writes the explanation 

{
  "error": {
    "message": "The model `gpt-3.5-turbo` does not exist or you do not have access to it.",
    "type": "invalid_request_error",
    "code": "model_not_found"
  }
}

A temporary workaround is to always have silent mode on.