Add the spark prefix to all existing configs and allow them to co-exist in the config.
Users can set via both methods sedona. or spark.sedona. but when both options present, the parameter set through sedona prefix will override the parameter set through spark.sedona prefix.
How was this patch tested?
Passed existing tests
Did this PR include necessary documentation updates?
Did you read the Contributor Guide?
Is this PR related to a JIRA ticket?
[SEDONA-651] my subject
.What changes were proposed in this PR?
Add the
spark
prefix to all existing configs and allow them to co-exist in the config.Users can set via both methods
sedona.
orspark.sedona.
but when both options present, the parameter set throughsedona
prefix will override the parameter set throughspark.sedona
prefix.How was this patch tested?
Passed existing tests
Did this PR include necessary documentation updates?