Extends the caching mechanism to also allow for using the inbuilt Spark caching. In order to force the caching to happen, an inexpensive operation, rdd.isEmpty is called.
Type of change
Please delete options that are not relevant.
[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
Description
Extends the caching mechanism to also allow for using the inbuilt Spark caching. In order to force the caching to happen, an inexpensive operation,
rdd.isEmptyis called.Type of change
Please delete options that are not relevant.
How Has This Been Tested?
Unit tests are all passing