search

smol-ai / developer

the first library to let you embed a developer agent in your own app!
https://twitter.com/SmolModels
MIT License
11.79k stars 1.03k forks source link

Option to use alternatives to Openai #90

Open apcameron opened 1 year ago

apcameron commented 1 year ago

I am trying to use alternatives to openai One alternative is to use https://github.com/go-skynet/LocalAI Another is to use llama.cpp with the python API plugin which I have partially working. I just need to find a good model to use to generate code.

It would be nice to have official support for alternative locally housed alternatives

d3287t328 commented 1 year ago

try this one https://huggingface.co/replit/replit-code-v1-3b/tree/main

OWL7seven commented 1 year ago

I would like to see an option to choose other local models for noobs like me.

Dr-42 commented 1 year ago

Any progress on this yet? Or if someone has forked and implemented it that would be great too.

shusso commented 1 year ago

@apcameron I wonder would StarCoder be a good model https://huggingface.co/bigcode/starcoder#intended-use

apcameron commented 1 year ago

@shusso It may be but I do not have enough RAM to try that model on my local computers.

iamjameswalters commented 11 months ago

Is anyone looking into this? I'd absolutely love this tool, but using a non-local LLM model is a no-go for me.