search

AbsaOSS / spline

Data Lineage Tracking And Visualization Solution
https://absaoss.github.io/spline/
Apache License 2.0
603 stars 155 forks source link

Export / Import lineage data #815

Open wajda opened 3 years ago

wajda commented 3 years ago

We could export/import the lineage. Imaginary example:

  1. I have a file A on HDFS, and its lineage in Spline
  2. I want to copy A to a different infrastructure (network, cluster, cloud, you name it), monitored by another independent Spline instance. And I don't want to loose the lineage of A
  3. Using Spline UI or CLI I dump A's full lineage to a file and carry it with A to a new infrastructure
  4. There the lineage dump can be imported manually (again by using UI or CLI), or even automatically on the first Spline tracked read from A.

Originally posted by @wajda in https://github.com/AbsaOSS/spline/issues/23#issuecomment-519600846

Jaykumar5121 commented 1 year ago

Hi, Is there any APIS to export the full lineages ? if yes then by HTTP request response can we export ?

wajda commented 1 year ago

Not yet. This feature hasn't gotten any priority so far.