fugue-project / fugue

A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.
https://fugue-tutorials.readthedocs.io/
Apache License 2.0
1.92k stars 94 forks source link

Implement all partitioning algos for dask, remove join from zip for all backends #499

Closed goodwanghan closed 11 months ago

codecov-commenter commented 11 months ago

Codecov Report

Patch coverage: 97.53% and project coverage change: -0.66% :warning:

Comparison is base (ff6128f) 100.00% compared to head (42c4b15) 99.34%.

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #499 +/- ## =========================================== - Coverage 100.00% 99.34% -0.66% =========================================== Files 128 128 Lines 12113 12184 +71 =========================================== - Hits 12113 12104 -9 - Misses 0 80 +80 ``` | [Files Changed](https://app.codecov.io/gh/fugue-project/fugue/pull/499?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=fugue-project) | Coverage Δ | | |---|---|---| | [fugue\_test/execution\_suite.py](https://app.codecov.io/gh/fugue-project/fugue/pull/499?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=fugue-project#diff-ZnVndWVfdGVzdC9leGVjdXRpb25fc3VpdGUucHk=) | `87.95% <75.00%> (-12.05%)` | :arrow_down: | | [fugue/collections/partition.py](https://app.codecov.io/gh/fugue-project/fugue/pull/499?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=fugue-project#diff-ZnVndWUvY29sbGVjdGlvbnMvcGFydGl0aW9uLnB5) | `100.00% <100.00%> (ø)` | | | [fugue/dataframe/utils.py](https://app.codecov.io/gh/fugue-project/fugue/pull/499?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=fugue-project#diff-ZnVndWUvZGF0YWZyYW1lL3V0aWxzLnB5) | `100.00% <100.00%> (ø)` | | | [fugue/execution/execution\_engine.py](https://app.codecov.io/gh/fugue-project/fugue/pull/499?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=fugue-project#diff-ZnVndWUvZXhlY3V0aW9uL2V4ZWN1dGlvbl9lbmdpbmUucHk=) | `100.00% <100.00%> (ø)` | | | [fugue/extensions/\_builtins/outputters.py](https://app.codecov.io/gh/fugue-project/fugue/pull/499?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=fugue-project#diff-ZnVndWUvZXh0ZW5zaW9ucy9fYnVpbHRpbnMvb3V0cHV0dGVycy5weQ==) | `100.00% <100.00%> (ø)` | | | [fugue/extensions/\_builtins/processors.py](https://app.codecov.io/gh/fugue-project/fugue/pull/499?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=fugue-project#diff-ZnVndWUvZXh0ZW5zaW9ucy9fYnVpbHRpbnMvcHJvY2Vzc29ycy5weQ==) | `100.00% <100.00%> (ø)` | | | [fugue\_dask/\_utils.py](https://app.codecov.io/gh/fugue-project/fugue/pull/499?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=fugue-project#diff-ZnVndWVfZGFzay9fdXRpbHMucHk=) | `100.00% <100.00%> (ø)` | | | [fugue\_dask/execution\_engine.py](https://app.codecov.io/gh/fugue-project/fugue/pull/499?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=fugue-project#diff-ZnVndWVfZGFzay9leGVjdXRpb25fZW5naW5lLnB5) | `100.00% <100.00%> (ø)` | | | [fugue\_ray/execution\_engine.py](https://app.codecov.io/gh/fugue-project/fugue/pull/499?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=fugue-project#diff-ZnVndWVfcmF5L2V4ZWN1dGlvbl9lbmdpbmUucHk=) | `100.00% <100.00%> (ø)` | | | [fugue\_spark/execution\_engine.py](https://app.codecov.io/gh/fugue-project/fugue/pull/499?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=fugue-project#diff-ZnVndWVfc3BhcmsvZXhlY3V0aW9uX2VuZ2luZS5weQ==) | `100.00% <100.00%> (ø)` | | | ... and [1 more](https://app.codecov.io/gh/fugue-project/fugue/pull/499?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=fugue-project) | | ... and [1 file with indirect coverage changes](https://app.codecov.io/gh/fugue-project/fugue/pull/499/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=fugue-project)

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.