search

morph-labs / rift

Rift: an AI-native language server for your personal AI software engineer
https://morph.so
Apache License 2.0
3.08k stars 149 forks source link

How to setup local models #239

Open TheBricktop opened 9 months ago

TheBricktop commented 9 months ago

Im trying to use local models without openai api, image image this is my setup, but every time im using rift I get this error image image

Does it mean that I have to download the model and set the path myself? Also it always asks me of openai api even though Im using local models.

Mayorc1978 commented 8 months ago

I tried and so far I failed any attempt with the extension with Visual Studio Code on W10. I get the same errors you get. I want to use LM studio and custom models and create an endpoint OpenAPI server. The problem with that is that I need to redirect the calls that rift coder makes to openai servers to local server instead, that requires rerouting the calls. But I want to avoid doing it by forcing that using DNS or something else. What I would like to know if there is a configuration file in rift extension where the address to openai server is stored and change that instead (since anyway I don't have an Openai account).