Sample doesn't work with Spark 3.x

[agaucher]

Hello,

The sample provided for Scala only works with Spark 2.4. Running the sample on a cluster 3.x generates an exception NoSuchMethodError : refArrayOps. Maybe you should update your documentation to warn the user about this.

Alexis

---

Document Details

⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

• ID: 86d23813-785f-73c5-33c6-d03c0861c17c
• Version Independent ID: f927bdb0-0e32-068d-5533-e4e4b43d46e8
• Content: Tutorial: Create Apache Spark job definition in Synapse Studio - Azure Synapse Analytics
• Content Source: articles/synapse-analytics/spark/apache-spark-job-definitions.md
• Service: synapse-analytics
• Sub-service: spark
• GitHub Login: @Jejiang
• Microsoft Alias: jejiang

[SaibabaBalapur-MSFT]

@agaucher Thanks for your feedback! We will investigate and update as appropriate.

[RamanathanChinnappan-MSFT]

@agaucher

I've delegated this to @Jejiang, a content author, to review and share their valuable insights.

[bandersmsft]

Thanks for your dedication to our documentation. Unfortunately, at this time we have been unable to review your issue in a timely manner and we sincerely apologize for the delayed response. We are closing this issue for now, but if you feel that it's still a concern, please respond and let us know. If you determine another possible update to our documentation, please don't hesitate to reach out again. #please-close