Transition to Azure Synapse runtime for Apache Spark 3.2 or 3.3

[tglink72]

All,

 Hello and hope all is well. We received a notification from Microsoft that the Synapse workloads we use for the BC2ADL tool are referencing a version of the Azure Synapse runtime for Apache Spark that will expire in September. While we do not use this functionality within our process, I believe we will need to update the references in the pipelines. Is there a current resolution to this in an existing version of the BC2ADL tool? Or is this issue being reviewed by the team?

Below is the notification.

Thanks

Tom Link

Transition to Azure Synapse runtime for Apache Spark 3.2 or 3.3 You're receiving this notice because you have workloads that use Azure Synapse runtime for Apache Spark 2.4 between April 12, 2023, and May 12, 2023. On 29 September 2023, Azure Synapse runtime for Apache Spark 2.4 will be retired in accordance with the Synapse runtime for Apache Spark lifecycle policy, and any workloads still using it will stop running. Before that date, you'll need to transition your workloads to version 3.2 or 3.3.

[DuttaSoumya]

Hi Tom (@tglink72),

Thanks for letting us know. Could you please try the following to get rid of this message,

• Refresh your setup of the shared metadata tables by following the instructions here.
• If that does not help, could you please refresh the setup of your Synapse workspace, or better still create a new one.

Best regards, Dutta CSA, Microsoft.

[DuttaSoumya]

Closing this out as it has been 2 weeks.