Closed mlcoop closed 1 year ago
Hi, For Spark 2.4.6 you would need to use sparkMeasure v 0.19 (latest version of sparkMEasure that works with Spark 2.4). sparkMeasure 0.22 only works with Spark 3.x.
is there difference in sparkMeasure implementation while using in cluster ?
@LucaCanali I am also using hadoop-> "3.2.0"
, is it compatible with 0.19 version ? because i started getting errors like java.lang.IllegalAccessError: class org.apache.hadoop.hdfs.web.HftpFileSystem cannot access its superinterface org.apache.hadoop.hdfs.web.TokenAspect$TokenManagementDelegator
Apparently it does, so i changed to 0.17 which seems to be working
Good to hear this is working for you.
Trying to use sparkMeasure in scala spark application. Get this error: