Check "Quality" tab on Datakin for Astro Python SDK Operators

[phanikumv]

Please describe the feature you'd like to see Try the Quality tab on Datakin for one of our operators. It it doesn't work yet, investigate the root cause and find what needs to be done to get there.

Refer to the discussion on https://astronomer.slack.com/archives/C03RTC9BQ4F/p1666099337802929?thread_ts=1666077697.818599&cid=C03RTC9BQ4F

Describe the solution you'd like A clear and concise description of what you want to happen, if possible with code examples.

Are there any alternatives to this feature? Is there another way we could solve this problem or enable this use-case?

Additional context Add any other context about the feature request here.

Acceptance Criteria

• [ ] All checks and tests in the CI should pass
• [ ] Unit tests (90% code coverage or more, once available)
• [ ] Integration tests (if the feature relates to a new database or external service)
• [ ] Example DAG
• [ ] Docstrings in reStructuredText for each of methods, classes, functions and module-level attributes (including Example DAG on how it should be used)
• [ ] Exception handling in case of errors
• [ ] Logging (are we exposing useful information to the user? e.g. source and destination)
• [ ] Improve the documentation (README, Sphinx, and any other relevant)
• [ ] How to use Guide for the feature (example)

[phanikumv]

Relevant thread to refer for the ongoing discussion.Dependent on OL team for a final resolution on this https://astronomer.slack.com/archives/C03RTC9BQ4F/p1666773402396019

[sunank200]

Following is the recording for the progress with Open lineage and deployment of example DAGs in Astro-Cloud and Marquez UI. Please find the link for recording as follows: https://astronomer.zoom.us/rec/share/bbm3QVZf7nhbBS-mPZVnxDCvbUJwgPZfKEhOBDDsyrb0DwwuWCAnMVfhBUtGbMZ1.YHeujc9MlLpezZmI Links to deployments on astro cloud for Open lineage: https://cloud.astronomer.io/lineage/graph/job/observational-fusion-5710/example_transform.last_five_animations?tab=inputs-outputs Passcode: 14G=kR$g

When deployed on Astro-cloud in this URL as per the demo recording, The quality tab is empty, but we have an output statistics facet. This should be fixed on the Astro-cloud side. This shows up on Marquez UI. outputStatistics: {size: 41033, rowCount: 117}

[sunank200]

More details can be found at: https://docs.google.com/document/d/1GZtJxpdQFlYj8vmgbm4IwW4XqDTw7HMclQ4ITMGxQ98/edit

[sunank200]

This issue can be tracked here: https://astronomer.slack.com/archives/C03RTC9BQ4F/p1673883567398019 and here https://astronomer.slack.com/archives/C02PABPU6B0/p1673891148435239