ayush-portkey
commented
9 months ago Thanks for the suggestion @ranjancse26. UI based workflow builder might definitely be helpful for a large number of use cases, I feel at the moment we would like to focus on the production reliability and accuracy more as compared to app development tooling.
You are absolutely right, in the near future workflow builder might become part of the platform. :)
Here's the thought based on the extensive experience in the field of building the workflow based LLM apps using the various open source libraries or frameworks; among them, Lastmile Aiconfig is the modern, easy to use config-driven based approach for building the production-grade AI applications in no time. The idea is to leverage and utilize the techniques to incorporate the workflow driven mechanism on Portkey. I understand, although it's not the CORE responsibility of the gateway, however it's could be part of the "Prompt Library" management. Who knows, in the near future, you could also be thinking about incorporate the workflow based mechanism as part of your platform.