starlake-ai / starlake

Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.
http://starlake.ai/
Apache License 2.0
57 stars 22 forks source link

update sl python libraries and dag templates for airflow and dagster #911

Closed fupelaqu closed 2 months ago

fupelaqu commented 6 months ago

Summary

A clear and concise description of the overall goals of the pull request's commits.

Related Issue: #IssueId

PR Type: Bug Fix | Feature | Documentation

Status: WIP/Ready to review

Breaking change? Yes/No

Description

Solution

Describe your changes in detail

How has this been tested?

Outline the steps taken to test the PR (unit tests? Integration tests? tested impacts on other project features? ...)

Other changes

Describe any other additional work done: bug fixes, tweaks, small refactors

Deploy Notes

Notes regarding deployment of the contained body of work. These should note any new dependencies, new scripts, new environment variables, ...

Remaining Todos

This should be done before merging this PR:

Contributor checklist:

Go over all the following points, and put an x in all the boxes that apply. If you're unsure about any of these, don't hesitate to ask. We're here to help!