Portkey-AI / gateway

A Blazing Fast AI Gateway with integrated Guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
https://portkey.ai/features/ai-gateway
MIT License
6.19k stars 441 forks source link

Suggestion or Request to have a workflow driven AI config mechanism #145

Open ranjancse26 opened 9 months ago

ranjancse26 commented 9 months ago

Here's the thought based on the extensive experience in the field of building the workflow based LLM apps using the various open source libraries or frameworks; among them, Lastmile Aiconfig is the modern, easy to use config-driven based approach for building the production-grade AI applications in no time. The idea is to leverage and utilize the techniques to incorporate the workflow driven mechanism on Portkey. I understand, although it's not the CORE responsibility of the gateway, however it's could be part of the "Prompt Library" management. Who knows, in the near future, you could also be thinking about incorporate the workflow based mechanism as part of your platform.

ayush-portkey commented 9 months ago

Thanks for the suggestion @ranjancse26. UI based workflow builder might definitely be helpful for a large number of use cases, I feel at the moment we would like to focus on the production reliability and accuracy more as compared to app development tooling.

You are absolutely right, in the near future workflow builder might become part of the platform. :)