kedro-org / kedro

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
https://kedro.org
Apache License 2.0
9.49k stars 875 forks source link

Release `0.19.4` #3798

Closed ElenaKhaustova closed 2 months ago

ElenaKhaustova commented 3 months ago

Description

Release 0.19.4 🎉

Development notes

Developer Certificate of Origin

We need all contributions to comply with the Developer Certificate of Origin (DCO). All commits must be signed off by including a Signed-off-by line in the commit message. See our wiki for guidance.

If your PR is blocked due to unsigned commits, then you must follow the instructions under "Rebase the branch" on the GitHub Checks page for your PR. This will retroactively add the sign-off to all unsigned commits and allow the DCO check to pass.

Checklist

noklam commented 2 months ago

I suggest this in RELEASE.md as I cannot comment on unchanged file in PR.

#  Release 0.19.4

## Major features and improvements
* Kedro commands now work from any subdirectory within a Kedro project.
* Kedro CLI now provides a better error message when project commands are run outside of a project i.e. `kedro run`
* Added the `--telemetry` flag to `kedro new`, allowing the user to register consent to have user analytics collected at the same time as the project is created.
* Improved suggestions to resume failed pipeline runs.
* Improved the performance of `Pipeline` object creation and summing.
* Dropped the dependency on `toposort` in favour of the built-in `graphlib` module.
* Cookiecutter errors are shown in short format without the `--verbose` flag.

## Bug fixes and other changes
* Updated `kedro pipeline create` and `kedro pipeline delete` to read the base environment from the project settings.
* Updated CLI command `kedro catalog resolve` to read credentials properly.
* Changed the path of where pipeline tests generated with `kedro pipeline create` from `<project root>/src/tests/pipelines/<pipeline name>` to `<project root>/tests/pipelines/<pipeline name>`.
* Updated ``.gitignore`` to prevent pushing Mlflow local runs folder to a remote forge when using mlflow and git.
* Fixed error handling message for malformed yaml/json files in `OmegaConfigLoader`.
* Fixed a bug in `node`-creation allowing self-dependencies when using transcoding, that is datasets named like `name@format`.
* Improved error message when passing wrong value to node.

## Breaking changes to the API
* Methods `_is_project` and `_find_kedro_project` have been moved to `kedro.utils`. We recommend not using private methods in your code, but if you do, please update your code to use the new location.

## Documentation changes
* Added documentation on best practices for testing nodes and pipelines.
* Added missing description for `merge_strategy` argument in OmegaConfigLoader.
* Clarified docs around using custom resolvers without a full Kedro project.
ElenaKhaustova commented 2 months ago

We need to update the RELEASE.md

Done