Support for Groq

[avcode-exe]

Any plans on integrating Groq? It is very fast and can save a lot of time when comparing with other options. Groq link: https://console.groq.com/docs/quickstart

[brianpetro]

@avcode-exe I have wanted to, it's very impressive.

It's just a hard balance between this sort of marginal improvement and shipping new features that I think could be 10X improvements.

That's why I made contributing adapters for these additional services as easy as possible, see https://github.com/brianpetro/jsbrains/issues/1#issuecomment-2071271220 for some details.

I'd like to say I'll get to it myself eventually, but it would of course be much faster if someone could contribute the adapter.

Thanks for participating in the Smart Connections community 😊🌴

[seanrose]

It looks like Groq has an OpenAI endpoint: https://console.groq.com/docs/openai

However, when I try it with the Custom API (OpenAl format) option, Smart Connections throws an invalid API key error. Am I doing something wrong, or is this expected?

[brianpetro]

@seanrose it's probably that the API key is handled different, even if the rest of the API format is the same.

It might be possible to already override this via the platforms.json config, but I'll have to check it out.

[OnfrICiA]

@seanrose I've just tested & got it to work - I believe the "path" needs to be: /openai/v1/chat/completions

e.g.

[linmaobang]

@seanrose I've just tested & got it to work - I believe the "path" needs to be:我刚刚测试并让它工作 - 我相信“路径”需要： /openai/v1/chat/completions

e.g. 例如：

It doesn't work either.

[OnfrICiA]

Definitely working for me @linmaobang . Version: 2.1.63

Confirming settings: Model Platform = Custom API (OpenAl format) Model Name = llama3-70b-8192 Protocol = https Hostname = api.groq.com Path = /openai/v1/chat/completions Streaming = OFF Max input tokens = 8192 API Key = [starts with gsk...]

Here's my console:

What does your console say?

[linmaobang]

Definitely working for me @linmaobang .绝对为我工作. Version: 2.1.63 版本： 2.1.63

Confirming settings: 确认设置： Model Platform = Custom API (OpenAl format)模型平台 = 自定义 API（OpenAl 格式） Model Name = llama3-70b-8192型号名称 = llama3-70b-8192 Protocol = https 协议 = https Hostname = api.groq.com 主机名 = api.groq.com Path = /openai/v1/chat/completions路径 = /openai/v1/chat/completions Streaming = OFF 流 = 关闭 Max input tokens = 8192最大输入令牌数 = 8192 API Key = [starts with gsk...]API 密钥 = [以 gsk 开头...]

Here's my console: 这是我的控制台：

What does your console say?你的控制台怎么说？

This is so cool!Successful, after restarting Obsidian.thanks a lot!

[xixia123]

@seanrose I've just tested & got it to work - I believe the "path" needs to be: /openai/v1/chat/completions

e.g.

It works for me!

[mayeenulislam]

The issue can be closed. The solution provided by OnfrICiA is working just fine.

[christianngarcia]

Thanks for following up. 😊