search

dustinblackman / oatmeal

Terminal UI to chat with large language models (LLM) using different model backends, and integrations with your favourite editors!
https://dustinblackman.com/posts/oatmeal/
MIT License
499 stars 24 forks source link

groq api fails health check #66

Open Aman9das opened 6 months ago

Aman9das commented 6 months ago 
RUST_BACKTRACE=1 ./oatmeal -b openai --open-ai-url https://api.groq.com/openai --open-ai-token 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 -m mixtral-8x7b-32768

I run this in the terminal but it gives this error: image

Thus the api is working as intended, but it's not passing the health check.. also no error in the console. Get your own api-key at https://console.groq.com/keys

Problem: neovim doesn't work as well because the file content isn't loaded due to this error.

relevant area: https://github.com/dustinblackman/oatmeal/blob/012ef3cb2b29c847722a3373a4410c1a12eecb0a/src/infrastructure/backends/openai.rs#L121

Aman9das commented 6 months ago

Also could settings health check duration to 0 disable it?