hablapps / doric

Type safety for spark columns
https://www.hablapps.com/doric/
Apache License 2.0
76 stars 11 forks source link

Feature/spark 3.5 #435

Closed alfonsorr closed 6 months ago

alfonsorr commented 6 months ago

Spark 3.5.1 was added to compile against.

Description

Spark 3.5, what else to say!!!

Related Issues and dependencies

Partially resolves #394

How Has This Been Tested?

CI updated to check that everything works as expected.

github-actions[bot] commented 6 months ago

:octocat: This is an auto-generated comment created by:

Actor Triggering actor Sender
alfonsorr
alfonsorr
alfonsorr
alfonsorr
alfonsorr
alfonsorr
Triggered by: - Workflow name: "CI" at .github/workflows/ci.yml - URL: [https://github.com/hablapps/doric/actions/runs/8210353287](https://github.com/hablapps/doric/actions/runs/8210353287) - on workflow_run:completed

Test summary report 📊

Spark version testing
3.0.0 684 passed, 2 skipped
3.0.1 684 passed, 2 skipped
3.0.2 684 passed, 2 skipped
3.0 684 passed, 2 skipped
3.1.0 712 passed, 2 skipped
3.1.1 712 passed, 2 skipped
3.1.2 712 passed, 2 skipped
3.1 712 passed, 2 skipped
3.2.0 716 passed, 2 skipped
3.2.1 716 passed, 2 skipped
3.2.2 716 passed, 2 skipped
3.2 716 passed, 2 skipped
3.3.0 716 passed, 2 skipped
3.3.1 716 passed, 2 skipped
3.3.2 716 passed, 2 skipped
3.3.3 716 passed, 2 skipped
3.3 716 passed, 2 skipped
3.4.0 716 passed, 2 skipped
3.4.1 716 passed, 2 skipped
3.4 716 passed, 2 skipped
3.5.0 716 passed, 2 skipped
3.5 716 passed, 2 skipped
codecov[bot] commented 6 months ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 97.69%. Comparing base (be8f352) to head (9eca4f6).

Additional details and impacted files [![Impacted file tree graph](https://app.codecov.io/gh/hablapps/doric/pull/435/graphs/tree.svg?width=650&height=150&src=pr&token=N7ZXUXZX1I&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hablapps)](https://app.codecov.io/gh/hablapps/doric/pull/435?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hablapps) ```diff @@ Coverage Diff @@ ## main #435 +/- ## ======================================= Coverage 97.69% 97.69% ======================================= Files 62 62 Lines 1255 1255 Branches 37 37 ======================================= Hits 1226 1226 Misses 29 29 ``` | [Flag](https://app.codecov.io/gh/hablapps/doric/pull/435/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hablapps) | Coverage Δ | | |---|---|---| | [spark-3.0.x](https://app.codecov.io/gh/hablapps/doric/pull/435/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hablapps) | `96.71% <ø> (ø)` | | | [spark-3.1.x](https://app.codecov.io/gh/hablapps/doric/pull/435/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hablapps) | `97.45% <ø> (ø)` | | | [spark-3.2.x](https://app.codecov.io/gh/hablapps/doric/pull/435/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hablapps) | `97.66% <ø> (ø)` | | | [spark-3.3.x](https://app.codecov.io/gh/hablapps/doric/pull/435/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hablapps) | `97.66% <ø> (ø)` | | | [spark-3.4.x](https://app.codecov.io/gh/hablapps/doric/pull/435/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hablapps) | `97.66% <ø> (ø)` | | | [spark-3.5.x](https://app.codecov.io/gh/hablapps/doric/pull/435/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hablapps) | `97.66% <ø> (?)` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hablapps#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files](https://app.codecov.io/gh/hablapps/doric/pull/435?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hablapps) | Coverage Δ | | |---|---|---| | [...re/src/main/scala/doric/syntax/StringColumns.scala](https://app.codecov.io/gh/hablapps/doric/pull/435?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hablapps#diff-Y29yZS9zcmMvbWFpbi9zY2FsYS9kb3JpYy9zeW50YXgvU3RyaW5nQ29sdW1ucy5zY2FsYQ==) | `100.00% <ø> (ø)` | | | [....3\_3.4\_3.5/scala/doric/syntax/ArrayColumns3x.scala](https://app.codecov.io/gh/hablapps/doric/pull/435?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hablapps#diff-Y29yZS9zcmMvbWFpbi9zcGFya18zLjBfMy4xXzMuMl8zLjNfMy40XzMuNS9zY2FsYS9kb3JpYy9zeW50YXgvQXJyYXlDb2x1bW5zM3guc2NhbGE=) | `100.00% <ø> (ø)` | | | [...3\_3.4\_3.5/scala/doric/syntax/CommonColumns3x.scala](https://app.codecov.io/gh/hablapps/doric/pull/435?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hablapps#diff-Y29yZS9zcmMvbWFpbi9zcGFya18zLjBfMy4xXzMuMl8zLjNfMy40XzMuNS9zY2FsYS9kb3JpYy9zeW50YXgvQ29tbW9uQ29sdW1uczN4LnNjYWxh) | `100.00% <ø> (ø)` | | | [....2\_3.3\_3.4\_3.5/scala/doric/syntax/DStructs3x.scala](https://app.codecov.io/gh/hablapps/doric/pull/435?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hablapps#diff-Y29yZS9zcmMvbWFpbi9zcGFya18zLjBfMy4xXzMuMl8zLjNfMy40XzMuNS9zY2FsYS9kb3JpYy9zeW50YXgvRFN0cnVjdHMzeC5zY2FsYQ==) | `100.00% <ø> (ø)` | | | [...\_3.3\_3.4\_3.5/scala/doric/syntax/MapColumns3x.scala](https://app.codecov.io/gh/hablapps/doric/pull/435?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hablapps#diff-Y29yZS9zcmMvbWFpbi9zcGFya18zLjBfMy4xXzMuMl8zLjNfMy40XzMuNS9zY2FsYS9kb3JpYy9zeW50YXgvTWFwQ29sdW1uczN4LnNjYWxh) | `100.00% <ø> (ø)` | | | [....3\_3.4\_3.5/scala/doric/syntax/StringColumn3x.scala](https://app.codecov.io/gh/hablapps/doric/pull/435?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hablapps#diff-Y29yZS9zcmMvbWFpbi9zcGFya18zLjBfMy4xXzMuMl8zLjNfMy40XzMuNS9zY2FsYS9kb3JpYy9zeW50YXgvU3RyaW5nQ29sdW1uM3guc2NhbGE=) | `100.00% <ø> (ø)` | | | [...doric/RelationalGroupedDatasetDoricInterface.scala](https://app.codecov.io/gh/hablapps/doric/pull/435?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hablapps#diff-Y29yZS9zcmMvbWFpbi9zcGFya18zLjBfMy4xXzMuMl8zLjNfMy40XzMuNS9zY2FsYS9vcmcvYXBhY2hlL3NwYXJrL3NxbC9kb3JpYy9SZWxhdGlvbmFsR3JvdXBlZERhdGFzZXREb3JpY0ludGVyZmFjZS5zY2FsYQ==) | `100.00% <ø> (ø)` | | | [...\_3.5/scala/doric/syntax/AggregationColumns31.scala](https://app.codecov.io/gh/hablapps/doric/pull/435?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hablapps#diff-Y29yZS9zcmMvbWFpbi9zcGFya18zLjFfMy4yXzMuM18zLjRfMy41L3NjYWxhL2RvcmljL3N5bnRheC9BZ2dyZWdhdGlvbkNvbHVtbnMzMS5zY2FsYQ==) | `100.00% <ø> (ø)` | | | [...\_3.4\_3.5/scala/doric/syntax/BooleanColumns31.scala](https://app.codecov.io/gh/hablapps/doric/pull/435?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hablapps#diff-Y29yZS9zcmMvbWFpbi9zcGFya18zLjFfMy4yXzMuM18zLjRfMy41L3NjYWxhL2RvcmljL3N5bnRheC9Cb29sZWFuQ29sdW1uczMxLnNjYWxh) | `100.00% <ø> (ø)` | | | [...\_3.4\_3.5/scala/doric/syntax/NumericColumns31.scala](https://app.codecov.io/gh/hablapps/doric/pull/435?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hablapps#diff-Y29yZS9zcmMvbWFpbi9zcGFya18zLjFfMy4yXzMuM18zLjRfMy41L3NjYWxhL2RvcmljL3N5bnRheC9OdW1lcmljQ29sdW1uczMxLnNjYWxh) | `100.00% <ø> (ø)` | | | ... and [5 more](https://app.codecov.io/gh/hablapps/doric/pull/435?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hablapps) | | ------ [Continue to review full report in Codecov by Sentry](https://app.codecov.io/gh/hablapps/doric/pull/435?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hablapps). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hablapps) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://app.codecov.io/gh/hablapps/doric/pull/435?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hablapps). Last update [be8f352...9eca4f6](https://app.codecov.io/gh/hablapps/doric/pull/435?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hablapps). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hablapps).