kedro-org / kedro

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
https://kedro.org
Apache License 2.0
10.03k stars 906 forks source link

Catalog to config #4323

Open ElenaKhaustova opened 2 weeks ago

ElenaKhaustova commented 2 weeks ago

Description

Made on top of https://github.com/kedro-org/kedro/pull/4347 (review it first)

Implementation of https://github.com/kedro-org/kedro/issues/4329

Full context: https://github.com/kedro-org/kedro/issues/3932#issuecomment-2474006376

TODO:

Development notes

To run pytest tests/io/test_kedro_data_catalog.py::TestKedroDataCatalog::TestKedroDataCatalogFromConfig or see an example from How to test section in #4329

Developer Certificate of Origin

We need all contributions to comply with the Developer Certificate of Origin (DCO). All commits must be signed off by including a Signed-off-by line in the commit message. See our wiki for guidance.

If your PR is blocked due to unsigned commits, then you must follow the instructions under "Rebase the branch" on the GitHub Checks page for your PR. This will retroactively add the sign-off to all unsigned commits and allow the DCO check to pass.

Checklist

ElenaKhaustova commented 12 hours ago

Is it worth splitting the version validation PR separately? Or is it tied to the "catalog to config" prototype in any way?

https://github.com/kedro-org/kedro/pull/4347