datarootsio / skeleton-pyspark

A best-practices first project template that allows you to get started on a new pyspark project
MIT License
13 stars 4 forks source link

Bump pyspark from 3.1.2 to 3.3.1 #76

Closed dependabot[bot] closed 1 year ago

dependabot[bot] commented 1 year ago

Bumps pyspark from 3.1.2 to 3.3.1.

Commits
  • fbbcf94 Preparing Spark release v3.3.1-rc4
  • ca60665 [SPARK-40703][SQL] Introduce shuffle on SinglePartition to improve parallelism
  • 27ca30a [SPARK-40782][BUILD] Upgrade jackson-databind to 2.13.4.1
  • 442ae56 [SPARK-8731] Beeline doesn't work with -e option when started in background
  • fdc51c7 [SPARK-40705][SQL] Handle case of using mutable array when converting Row to ...
  • 9f8eef8 [SPARK-40682][SQL][TESTS] Set spark.driver.maxResultSize to 3g in `SqlBased...
  • 5a23f62 Preparing development version 3.3.2-SNAPSHOT
  • 7c465bc Preparing Spark release v3.3.1-rc3
  • 5fe895a [SPARK-40660][SQL][3.3] Switch to XORShiftRandom to distribute elements
  • 5dc9ba0 [SPARK-40669][SQL][TESTS] Parameterize rowsNum in InMemoryColumnarBenchmark
  • Additional commits viewable in compare view


Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
dependabot[bot] commented 1 year ago

Superseded by #82.