Closed guoqiao1992 closed 3 years ago
Issue #, if available: Spark container only supports spark 3.0.0 today. Need to support 3.1.1 due to bug fixes.
Description of changes: Add configuration to support spark 3.1.1(emr 6.3.0)
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.
NICE! Thank you.
Issue #, if available: Spark container only supports spark 3.0.0 today. Need to support 3.1.1 due to bug fixes.
Description of changes: Add configuration to support spark 3.1.1(emr 6.3.0)
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.