search

keldenl / gpt-llama.cpp

A llama.cpp drop-in replacement for OpenAI's GPT endpoints, allowing GPT-powered apps to run off local llama.cpp models instead of OpenAI.
MIT License
591 stars 65 forks source link

Add support for ai-code-translator #3

Open keldenl opened 1 year ago

keldenl commented 1 year ago

Project: https://github.com/mckaywrigley/ai-code-translator

keldenl commented 1 year ago

I've created a pull request that'll help get out-of-the-box support for gpt-llama.cpp in https://github.com/mckaywrigley/ai-code-translator/pull/32

For now my fork (https://github.com/keldenl/ai-code-translator/tree/add-base-url) can be pulled instead to get this working for now

keldenl commented 1 year ago

will write docs once the PR is in, but running OPENAI_API_HOST=http://localhost:443 npm run dev with my fork should do the job