Describe the bug, including details regarding any error messages, version, and platform.
Details in #637
I think we should add a check that we are updating all the keys only if they are actually present. It should be a very rare case and it looks more like a bug in Spark itself that they broke back-compatibility in a minor release.
Anyway, we can add a simple code that checks that a conf exists.
Describe the bug, including details regarding any error messages, version, and platform.
Details in #637
I think we should add a check that we are updating all the keys only if they are actually present. It should be a very rare case and it looks more like a bug in Spark itself that they broke back-compatibility in a minor release.
Anyway, we can add a simple code that checks that a conf exists.
Component(s)
Spark