search

microsoft / promptflow

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.
https://microsoft.github.io/promptflow/
MIT License
8.7k stars 780 forks source link

[Feature Request] Track runs in self deployed MLFlow server #2210

Open ankitbko opened 4 months ago

ankitbko commented 4 months ago

I would like to track the experiment runs on self deployed MLFlow server. Currently I don't find any ways to pass mlflow_tracking_uri to PFClient and have it track everything in mlflow server. This feature is centrally track the experiment runs when not using AML to run the flows.

D-W- commented 4 months ago

Hi @ankitbko , we don't have plans to support this in the near future. I will place it on the long-term roadmap.

melmatlis commented 3 months ago

Is there a mitigation in which we can track local PF runs alongside AML runs, compare metrics etc.?

D-W- commented 3 months ago

Hi @melmatlis , we are working on a feature to track local run in cloud, + @wangchao1230 for more details.

wangchao1230 commented 3 months ago

Yes. We are designing the experience to track local PF runs in AML workspace. I will update here if we have something to share.