search

Azure-Samples / modern-data-warehouse-dataops

DataOps for Microsoft Data Platform technologies. https://aka.ms/dataops-repo
MIT License
590 stars 462 forks source link

chore(deps): bump pyspark from 3.2.2 to 3.3.2 in /e2e_samples/parking_sensors/src/ddo_transform #760

Closed dependabot[bot] closed 23 hours ago

dependabot[bot] commented 1 month ago

Bumps pyspark from 3.2.2 to 3.3.2.

Commits
  • 5103e00 Preparing Spark release v3.3.2-rc1
  • 307ec98 [MINOR][SS] Fix setTimeoutTimestamp doc
  • 7205567 [SPARK-40819][SQL][FOLLOWUP] Update SqlConf version for nanosAsLong configura...
  • 3ec9b05 [SPARK-40819][SQL][3.3] Timestamp nanos behaviour regression
  • 51ed6ba [SPARK-41962][MINOR][SQL] Update the order of imports in class SpecificParque...
  • 17b7123 [SPARK-42346][SQL] Rewrite distinct aggregates after subquery merge
  • cdb494b [SPARK-42344][K8S] Change the default size of the CONFIG_MAP_MAXSIZE
  • 2d539c5 [SPARK-41554] fix changing of Decimal scale when scale decreased by m…
  • 6e0dfa9 [MINOR][DOCS][PYTHON][PS] Fix the .groupby() method docstring
  • 80e8df1 [SPARK-42259][SQL] ResolveGroupingAnalytics should take care of Python UDAF
  • Additional commits viewable in compare view


Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) You can disable automated security fix PRs for this repo from the [Security Alerts page](https://github.com/Azure-Samples/modern-data-warehouse-dataops/network/alerts).
bsherwin commented 1 week ago

@ydaponte Since we are working on this E2E sample for databricks, do we have any input on this update?

promisinganuj commented 1 week ago

I would recommend doing this upgrade. @bsherwin , @ydaponte do you have any latest deployment of this sample. We can quickly check if it's breaking anything.

ydaponte commented 1 week ago

@promisinganuj and @bsherwin - nothing against but it needs to be fully tested first. I was planning to include this testing on the next sprint unless any of you tested it already?

promisinganuj commented 1 week ago

If you are picking it in the next cycle, we can leave it for now.

ydaponte commented 23 hours ago

PySpark 3.3.2 is compatible with python 8 - which is the combination that is used on the release pipelines where this file is required. Merging the PR. cc: @promisinganuj and @bsherwin

promisinganuj commented 22 hours ago

[like] Anuj Parashar reacted to your message:

From: Yennifer Santos @.> Sent: Thursday, November 21, 2024 11:28:49 AM To: Azure-Samples/modern-data-warehouse-dataops @.> Cc: Anuj Parashar @.>; Mention @.> Subject: Re: [Azure-Samples/modern-data-warehouse-dataops] chore(deps): bump pyspark from 3.2.2 to 3.3.2 in /e2e_samples/parking_sensors/src/ddo_transform (PR #760)

PySpark 3.3.2 is compatible with python 8 - which is the combination that is used on the release pipelines where this file is required. Merging the PR. cc: @promisinganujhttps://github.com/promisinganuj and @bsherwinhttps://github.com/bsherwin

— Reply to this email directly, view it on GitHubhttps://github.com/Azure-Samples/modern-data-warehouse-dataops/pull/760#issuecomment-2490866201, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ACWDQCIB6TRFU5WHJO2NEWL2BW7XDAVCNFSM6AAAAABP7ZIYIWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIOJQHA3DMMRQGE. You are receiving this because you were mentioned.Message ID: @.***>