search

smol-ai / developer

the first library to let you embed a developer agent in your own app!
https://twitter.com/SmolModels
MIT License
11.73k stars 1.03k forks source link

how to use codellama instead of openai api? #154

Open ouvaa opened 5 months ago

ouvaa commented 5 months ago

how to use codellama instead of openai api? how to make it use llama.cpp?

uniAIDevs commented 3 months ago

I'm working on a solution to integrate the HuggingFace inference API into the program! I'll consider adding an additional feature for this. This may take some time, but I use other developer agents to speed up the small tasks. There will be a alternate version created by me soon!

bvelker commented 3 months ago

It might be more efficient to integrate LiteLLM https://github.com/BerriAI/litellm It already has access to basically all LLM api's, including Huggingface and Openrouter

timiil commented 2 months ago

It might be more efficient to integrate LiteLLM https://github.com/BerriAI/litellm It already has access to basically all LLM api's, including Huggingface and Openrouter

any example that we can use LiteLLM inside this project