search

dagster-io / dagster

An orchestration platform for the development, production, and observation of data assets.
https://dagster.io
Apache License 2.0
10.7k stars 1.33k forks source link

monte carlo data observability tool integration #12110

Open aabdullah-getguru opened 1 year ago

aabdullah-getguru commented 1 year ago

What's the use case?

Monte Carlo is a popular data observability tool, that tracks and alerts on data flows, as well as data lineage: https://docs.getmontecarlo.com/docs

They have integrations with Prefect and Airflow - it would be ideal if Dagster could also support being able to integrate with Monte Carlo.

Ideas of implementation

I'm not sure. This might be one that involves talking with people at Monte Carlo, since it is not an open source tool.

Additional information

The need for this integration is a deal breaker to my startup, since data observability is a huge pillar of our data strategy.

Message from the maintainers

Impacted by this issue? Give it a 👍! We factor engagement into prioritization.

benpankow commented 1 year ago

Hi @aabdullah-getguru, thanks for submitting this integration request! This isn't on our immediate roadmap but building better integration with observability tools is something we'd like to improve. If this is something you would be interested in contributing we would be glad to review & merge a PR.

slopp commented 1 year ago

Plus one from another prospect for this integration