search

H0llyW00dzZ / ChatGPT-Next-Web

A well-designed cross-platform ChatGPT UI (Web / PWA / Linux / Win / MacOS). 一键拥有你自己的跨平台 ChatGPT 应用。
https://hackerchat.btz.sh
MIT License
18 stars 8 forks source link

Custom Endpoint Groq not Working [Bug] #305

Open senja24 opened 3 months ago

senja24 commented 3 months ago

Bug Description

Screenshot_2024-03-07-22-11-38-803_com android chrome Just set custom endpoint for groq but its not working

Stuck over there Screenshot_2024-03-07-22-11-51-623_com android chrome

Steps to Reproduce

  1. Enable custom endpoint
  2. Input groq api key
  3. Set endpoint https://api.groq.com/openai/
  4. Custom model mixtral-8x7b-32768,llama2-70b-4096

Expected Behavior

Working as fine. Get result fast

Screenshots

No response

Deployment Method

Desktop OS

No response

Desktop Browser

No response

Desktop Browser Version

No response

Smartphone Device

No response

Smartphone OS

No response

Smartphone Browser

No response

Smartphone Browser Version

No response

Additional Logs

No response

Issues-translate-bot commented 3 months ago

Bot detected the issue body's language is not English, translate it automatically.

Title: Custom Endpoint Groq not Working [Bug]

H0llyW00dzZ commented 3 months ago

Bug Description

Screenshot_2024-03-07-22-11-38-803_com android chrome Just set custom endpoint for groq but its not working

Stuck over there Screenshot_2024-03-07-22-11-51-623_com android chrome

Steps to Reproduce

  1. Enable custom endpoint
  2. Input groq api key
  3. Set endpoint https://api.groq.com/openai/
  4. Custom model mixtral-8x7b-32768,llama2-70b-4096

Expected Behavior

Working as fine. Get result fast

Screenshots

No response

Deployment Method

  • [ ] Docker
  • [x] Vercel
  • [ ] Server

Desktop OS

No response

Desktop Browser

No response

Desktop Browser Version

No response

Smartphone Device

No response

Smartphone OS

No response

Smartphone Browser

No response

Smartphone Browser Version

No response

Additional Logs

No response

This isn't a bug. I had disabled it before, but I might enable it again when I have free time.

H0llyW00dzZ commented 3 months ago

@senja24 try turn off/untick this for now, that you using custom model

image

senja24 commented 3 months ago

Screenshot_2024-03-08-05-18-45-650_com android chrome Already did to try this and same. Cannot using custom endpoint

Scipline commented 2 months ago

I have the same problem.Specifying provider information directly in the customModels string is not supported. Provider information needs to be specified through predefined models.

H0llyW00dzZ commented 2 months ago

I haven't addressed this issue yet, as I'm currently focusing on full-stack Golang development.