Create a new patchflow that will run an openai compatible endpoint as a proxy

patched-codes / patchwork

Automate development gruntwork like code reviews, patching and documentation with LLM workflows.

https://patched.codes

GNU Affero General Public License v3.0

819 stars 48 forks source link

Create a new patchflow that will run an openai compatible endpoint as a proxy #380

Closed codelion closed 1 month ago

codelion commented 2 months ago

patchwork RunOpenAIProxy

Allows users to run a proxy endpoint that is compatible with OpenAI chat completions API. But allows them to use it for any OpenAI, Google, Anthropic and HuggingFace LLMs.
This will be useful for running evals and optimized inference techniques like mixture-of-agents.

VARUN-KUSH commented 1 month ago

is this task progressing if not i would love to work on this

codelion commented 1 month ago

@VARUN-KUSH this will not be implemented as a patchflow as it doesn’t align with any development task as such. If you are looking to contribute the easiest thing to do is to add a new patchflow that solves any particular development task you may have.