janhq / cortex.cpp

Run and customize Local LLMs.
https://cortex.so
Apache License 2.0
1.94k stars 108 forks source link

feat: add FAQs for nitro documentation #168

Closed tikikun closed 10 months ago

hiro-v commented 10 months ago

@vuonghoainam on tutorials for ‘npm-openai’ and ‘python-openai’ integration code with nitro

tikikun commented 10 months ago
tikikun commented 10 months ago
tikikun commented 10 months ago

Hey, isn’t Nitro just Llama.cpp with an api serve

tikikun commented 10 months ago

Many applications implement openai chatgpt API, we want you to be able to use nitro on any AI clients that you want therefore the openai adapters have to be 100% compatible, you can put any model name there, but in case you already implement chatgpt api, we make sure that you can just replace api.openai.com with localhost:3928 and your chat clients will just work (chatbox, sillytavern, oobaboga,etc... )