search

microsoft / promptflow

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.
https://microsoft.github.io/promptflow/
MIT License
9.44k stars 859 forks source link

[Feature Request] Remove Flask/FastAPI from promptflow-core dependencies? #3340

Open pamelafox opened 5 months ago

pamelafox commented 5 months ago

Is your feature request related to a problem? Please describe.

We would like to bring promptflow-core into our web apps, but we're concerned about the Flask/FastAPI dependency as it may end up conflicting with our own dependencies, plus we can't afford to bring in a lot of dependencies, as our pip install is already too slow.

Could those dependencies be optionals or in another package? Why must they be in promptflow-core? Is there a more minimal package if we just want to use Prompty?

wxpjimmy commented 5 months ago

@pamelafox could you share some details about why you want to build your own web app instead of leveraging the PF serving app which already has good support for different engine and deployment? That will be very helpful for us to understand customer's requirement.

pamelafox commented 5 months ago

We are not using a microservices model, which I guess is what you're imagining? Instead, we're deploying a single monolithic app and would like to use promptflow as part of the web app calls. Microservices are popular, but so are monolithic apps, so we need to support both.