OPEN AI LIKE API doesn't work

coleam00 / bolt.new-any-llm

Prompt, run, edit, and deploy full-stack web applications using any LLM you want!

https://bolt.new

MIT License

1.24k stars 653 forks source link

OPEN AI LIKE API doesn't work #82

Open MattCarneiro opened 5 days ago

MattCarneiro commented 5 days ago

Describe the bug

I'm trying to use OPEN AI LIKE API on Bolt but don't seem to work at at all.

I set the environment variables and modified constants.ts file to include Open Ai Like, but still doesn't work

Link to the Bolt URL that caused the error

https://main-bolt.q9nzyb.easypanel.host/

Steps to reproduce

Choose the LLM
Ask for something
Gets an Error
Tried to modified Constants.ts (app/utils/constants.ts) to change default llm but still doesn't work

Expected behavior

Get an answer back from the model

Screen Recording / Screenshot

https://github.com/user-attachments/assets/318a8200-2754-4e7d-baca-2ec14dfcd383

Platform

Linux Ubuntu 22.04 ARM

Additional context

No response

MattCarneiro commented 3 days ago

hey @ZerxZ I tried to deploy your fork but still got the same error

ZerxZ commented 3 days ago

hey @ZerxZ I tried to deploy your fork but still got the same error

Hi, can you show me a screenshot, recording or error log?@MattCarneiro

I've tested openai like myself and it's fine.

MattCarneiro commented 3 days ago

@ZerxZ May you record a video on how are you setting?

I tried to modify constants.ts with the OpenAILike model but it still "empty" on the UI

ZerxZ commented 3 days ago

record a video link:https://files.catbox.moe/iqspc6.mp4 @MattCarneiro

MattCarneiro commented 3 days ago

EDIT - I was setting the .env in a wrong way

Thank you so much @ZerxZ You're amazing!

Keep it up the good work!

Peace

chrismahoney commented 1 day ago

OpenAILike

Hey there, could you possibly share a bit of detail in here regarding the fix you needed for .env? I'm sure it's going to come up repeatedly, as LM Studio is my goto "OpenAILike" and I hit this a lot while getting started.