great-expectations / great_expectations

Always know what to expect from your data.
https://docs.greatexpectations.io/
Apache License 2.0
9.86k stars 1.52k forks source link

[DOCS] update gx cloud and airflow doc #10025

Closed nicgrayson closed 2 months ago

nicgrayson commented 3 months ago

Update commands to run a local Airflow deployment and fix python code that connects to gx cloud

For more information about contributing, see Contribute.

After you submit your PR, keep the page open and monitor the statuses of the various checks made by our continuous integration process at the bottom of the page. Please fix any issues that come up and reach out on Slack if you need help. Thanks for contributing!

netlify[bot] commented 3 months ago

Deploy Preview for niobium-lead-7998 ready!

Name Link
Latest commit 9b539b624d79b17dd21a272ed0bb57cc6a46c710
Latest deploy log https://app.netlify.com/sites/niobium-lead-7998/deploys/6695645b7a9b7f0008083cd1
Deploy Preview https://deploy-preview-10025.docs.greatexpectations.io
Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

codecov[bot] commented 3 months ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 79.43%. Comparing base (b08b7f9) to head (9b539b6).

Additional details and impacted files ```diff @@ Coverage Diff @@ ## develop #10025 +/- ## =========================================== + Coverage 78.84% 79.43% +0.58% =========================================== Files 456 456 Lines 39748 39748 =========================================== + Hits 31340 31574 +234 + Misses 8408 8174 -234 ``` | [Flag](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | Coverage Δ | | |---|---|---| | [3.10](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `65.99% <ø> (-0.02%)` | :arrow_down: | | [3.10 aws_deps](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.10 big](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.10 databricks](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.10 filesystem](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.10 mssql](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.10 mysql](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.10 postgresql](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.10 snowflake](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.10 spark](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.10 trino](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.11](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `66.01% <ø> (-0.01%)` | :arrow_down: | | [3.11 aws_deps](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.11 big](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.11 databricks](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.11 filesystem](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.11 mssql](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.11 mysql](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.11 postgresql](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.11 snowflake](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.11 spark](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.11 trino](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.12](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `64.55% <ø> (ø)` | | | [3.12 aws_deps](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `45.81% <ø> (ø)` | | | [3.12 big](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `54.52% <ø> (ø)` | | | [3.12 filesystem](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `60.29% <ø> (ø)` | | | [3.12 mssql](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `49.91% <ø> (ø)` | | | [3.12 mysql](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `49.97% <ø> (ø)` | | | [3.12 postgresql](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `54.10% <ø> (ø)` | | | [3.12 spark](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `57.28% <ø> (ø)` | | | [3.12 trino](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `52.02% <ø> (ø)` | | | [3.8](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `66.05% <ø> (ø)` | | | [3.8 athena or clickhouse or openpyxl or pyarrow or project or sqlite or aws_creds](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `54.52% <ø> (ø)` | | | [3.8 aws_deps](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `45.84% <ø> (ø)` | | | [3.8 big](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `54.54% <ø> (ø)` | | | [3.8 databricks](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `46.97% <ø> (ø)` | | | [3.8 filesystem](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `60.31% <ø> (ø)` | | | [3.8 mssql](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `49.90% <ø> (ø)` | | | [3.8 mysql](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `49.96% <ø> (ø)` | | | [3.8 postgresql](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `54.09% <ø> (ø)` | | | [3.8 snowflake](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `47.88% <ø> (ø)` | | | [3.8 spark](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `57.25% <ø> (ø)` | | | [3.8 trino](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `52.01% <ø> (ø)` | | | [3.9](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `66.03% <ø> (ø)` | | | [3.9 aws_deps](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.9 big](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.9 databricks](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.9 filesystem](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.9 mssql](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.9 mysql](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.9 postgresql](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.9 snowflake](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.9 spark](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [3.9 trino](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `?` | | | [cloud](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `0.00% <ø> (?)` | | | [docs-basic](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `48.79% <ø> (?)` | | | [docs-creds-needed](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `49.94% <ø> (?)` | | | [docs-spark](https://app.codecov.io/gh/great-expectations/great_expectations/pull/10025/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations) | `48.65% <ø> (?)` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=great-expectations#carryforward-flags-in-the-pull-request-comment) to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.