Closed TejasRGitHub closed 1 week ago
Hi Team,
I was checking out Marquez and its ability to store lineage.
We have > 1000 jobs running , I wanted to know if Marquez is able to handle such a scale.
What are the mechanisms in open lineage spark Or in Marquez which can recover from any missed lineage event ?
Hi Team,
I was checking out Marquez and its ability to store lineage.
We have > 1000 jobs running , I wanted to know if Marquez is able to handle such a scale.
What are the mechanisms in open lineage spark Or in Marquez which can recover from any missed lineage event ?