getcursor / cursor

The AI Code Editor
https://cursor.com
25.55k stars 1.59k forks source link

Error connecting to unsupported large model vendors using llitellm #2351

Closed wuming123 closed 2 weeks ago

wuming123 commented 2 weeks ago

image image

It can be validated fine, but it's not possible to talk and edit the code, I don't understand why

image

When I find that it reports this error when I do a chat, no network request has occurred, so I'm assuming it's an error in validating some local data? image

Looking forward to your replies and solutions, thanks!

danperks commented 2 weeks ago

Hi @wuming123,

Unfortunately, locally hosted LLM or AI services are not compatible with Cursor, as Cursor's backend needs to be able to communicate with the endpoint you choose.

As a workaround, you can expose your localhost endpoint externally, so that Cursor can get to it, but I'd only recommend this if you can do this safely and securely!