This task is related to running a subset of IIS modules currently written in spark 2.4 on the newly available spark 3.4 version.
This may require:
altering oozie workflow definition by specifying a new sharelib name and defining other spark related configuration parameters such as app/query listeners, history server address, event log directory etc
dropping iis-common scala sources which are difficult to maintain (and results in false positive errors indicated by the Eclipse IDE) and replacing those simple utility classes with java equivalents
This task is related to running a subset of IIS modules currently written in spark 2.4 on the newly available spark 3.4 version.
This may require:
iis-commonscala sources which are difficult to maintain (and results in false positive errors indicated by the Eclipse IDE) and replacing those simple utility classes with java equivalents